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Absitmst 


The  purpose  of  this  study  is  to  demonstrate  the  feasibility  of  using  Kohonen  neural  nets  in 
speech  recognition.  This  is  done  by  combining  a  first  level  Kohonen  net  with  a  word  recognition 
algorithm  which  is  either  dynamic  time  warping  (DTW)  or  a  second  Kohonen  net. 


A  digitized  utterance  is  sliced  and  processed  to  obtain  a  sequence  of  15  component  vectors. 
Each  component  corresponds  to  the  energy  in  a  selected  frequency  range.  An  utterance  of  the 
digits  zero  through  nine  is  used  to  train  the  first  Kohonen  net.  After  training,  an  utterance  input 
to  the  net  produces  a  trajectory  through  the  net.  Each  point  on  the  trajectory  corresponds  to  a 
node  and  a  particular  sound. 


These  trajectories  are  input  to  a  word  recognition  algorithm.  The  first  of  these,  DTW,  com¬ 
pares  unknown  utterances  to  template  utterances.  It  is  a  computationally  intense,  mathematical 
algorithm,  and  it  was  used  primarily  to  test  the  preprocessing  and  neural  net  training  procedures. 
The  second  algorithm  is  a  second  Kohonen  neural  net.  Digits  are  assigned  to  each  node  so  that 
when  an  unknown  trajectory  is  input  to  the  second  net,  the  node  that  “lights  up”  identifies  the 
utterance. 


Using  DTW,  99%  isolated  and  93%  connected  speech  recognition  rates  are  achieved-  With  the 
second  Kohonen  net,  isolated  speech  is  recognized  at  up  to  96%,  depending  upon  the  net  format. 

Recommendations  for  future  effort  include  increasing  the  vocabulary,  using  multiple  feature 


sets  and  nets  to  attempt  speaker  independent  speech  recognition,  and  substituting  a  backward 
propagation  multi-layer  perceptron  net  for  word  recognition.  - 


SPEECH  RECOGNITION  USING  NEURAL  NETS 


AND  DYNAMIC  TIME  WARPING 


As  our  society  becomes  more  technically  oriented,  the  ability  to  efficiently  direct  both  mat- 
chines  and  computers  becomes  essential.  One  very  promising  way  of  increasing  that  control  is 
through  voice  direction  of  computer  controlled  devices.  Not  only  could  the  worker  use  hands  and 
feet  to  control  conveyances,  appliances,  computers  or  weapons,  he  could  also  use  voice. 

However,  in  addition  to  simply  expanding  the  number  of  methods  by  which  devices  are 
controlled,  voice  recognition  permits  simplification  of  the  interface  process.  Remember  the  last 
time  you  tried  to  play  a  tape  on  your  friend’s  new  stereo?  How  long  did  it  take  you  to  find 
the  ON/OFF  button?  Imagine  simply  saying,  “Stereo,  power  on”.  Considering  the  vastly  more 
complicated  process  of  controlling  a  fighter  aircraft,  the  anticipated  benefits  from  voice  control  in  a 
cockpit  are  immeasurably  greater.  Thus,  in  today’s  complicated  weapons  environment,  the  benefit 
to  the  military  of  a  working  voice  recognition  system  is  obvious. 

Problem 

Accordingly,  the  purpose  of  this  effort  is  to  demonstrate  the  feasibility  of  a  speech  recognition 
system  for  connected  speech — a  system  which  uses  neural  nets  to  simulate  the  activity  of  neurons 
and  potentially  take  advantage  of  parallel  processing  techniques.  The  feature  set  used  to  charac¬ 
terize  speech,  the  neural  net  training  process,  and  the  word  recognition  algorithms  (which  process 
the  output  from  the  neural  net)  are  varied  to  obtain  the  best  performance. 
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Background 


Unfortunately,  the  current  state  of  the  art  in  voice  recognition  does  not  allow  an  efficient 
transfer  of  information  between  humans  and  machines.  Speech  recognizers  limited  to  the  speech 
of  one  person,  with  distinct  pauses  between  each  word,  have  recognition  efficiencies  around  98% 
(1:57) — in  ideal  or  noise  free  environments  (2:29-32).  These  recognizers  fail  when  the  speech 
becomes  continuous  (without  distinct  pauses)  or  is  not  spoken  by  the  one  person  who  trained  the 
recognizer. 

Attempts  to  have  machines  recognize  continuous  speech  as  well  as  speaker  independent  speech 
are  limited  to  small  vocabularies,  require  immense  amounts  **  mputation,  and  are  relatively 
unsuccessful  (1:56;  2:29;  3:74-76;  4).  Speaker  independent  speech  recognition,  in  particular,  requires 
using  multiple  templates  (5:199)  ;  i.e.,  training  the  recognizer  with  more  than  one  voice,  thus 
limiting  the  usable  vocabularies  because  of  the  increased  computation. 

Attempts  to  use  a  form  of  parallel  processing  (or  at  least  a  serial  simulation)  to  minimize 
the  impact  of  computation  time  include  Kohonen’s  work  with  neural  nets  (6:15;  7.18;  8:184;  9). 
However,  his  work  is  directed  more  towards  producing  a  phonemic  transcription  of  speech  rather 
than  actual  whole  word  recognition. 

Problems  involved  in  using  neural  nets  to  recognize  speech  include  choosing  the  feature  set 
with  which  to  train  the  net  (the  age  old  problem  of  traditional  pattern  recognition),  finding  a  net 
with  the  optimum  performance,  and  processing  the  net  output  into  actual  words  and  sentences. 

Definitions 

Connected  Speech.  Since  the  problem  involves  recognizing  connected  speech,  a  definition 
is  essential.  Connected  speech  is  simply  an  utterance  in  which  distinct  pauses  are  not  intentionally 
provided  between  words.  When  distinct  pauses  are  included,  the  utterance  is  identified  as  isolated 
speech.  In  connected  speech,  words  may  be  pronounced  distinctly  (that  is,  the  pronunciation  is 
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not  chopped  or  smeared)  or  they  may  be  run  together  (where  the  words  are  chopped  or  smeared 
at  the  boundaries).  Additionally,  the  speed  with  which  words  are  spoken  varies.  Typically,  when 
isolated  speech  is  performed,  words  are  spoken  more  slowly  than  during  typical  conversations.  The 
difference  in  speeds  becomes  an  important  factor  in  properly  processing  the  neural  net  output  into 
recognized  words. 

Speaker  Independence.  While  the  same  person  generally  pronounces  the  same  words  simi¬ 
larly  time  after  time,  different  individuals  have  different  speech  organs  and  distinguishably  different 
sounding  voices.  In  addition,  a  person  from  the  Midwest  pronounces  words  differently  than  someone 
from  the  South.  Such  differences  create  significant  problems  in  recognizing  speaker  independent 
speech.  Accordingly,  the  speech  recognition  system  described  here  is  developed  using  speaker  de¬ 
pendent  utterances. 

Feature  Set.  A  feature  set  represents  or  characterizes  utterances  in  such  a  way  that  they 
are  distinguishable  from  other  utterances.  Usually,  the  feature  set  characterizes  only  a  small  slice 
of  time,  thus  requiring  a  sequence  of  slices  to  represent  the  whole  utterance.  Hence,  the  speech 
waveform  is  broken  up  into  distinct  time  slices  (possibly  overlapping)  which  are  then  transformed 
into  vectors  defined  from  the  chosen  feature  set. 

For  example,  in  this  research,  the  feature  set  is  the  narrow  band  frequency  spectrum.  The 
components  of  the  vectors  representing  each  time  slice  correspond  to  the  energy  in  sequential 
frequency  bands.  Thus  an  appropriate  transformation  is  either  the  fast  Fourier  transform  (FFT) 
(10:272-285)  or  afast  Hartley  transform  (FHT)  (11)  with  some  postprocessing  to  reduce  the  number 
of  frequency  bands  to  a  usable  number. 

Neural  Net.  After  the  feature  set  is  chosen  and  the  representative  utterance  is  sliced  up 
and  transformed  into  vectors,  it  is  time  to  train  and  use  a  neural  net. 

The  neural  net  simply  approximates  or  simulates  a  set  of  interconnected  neurons.  In  the 


present  work,  a  “Kohonen  neural  net”  (6:15-18;  7:18-20;  8:182-185)  is  a  simplified  simulation  of  a 
single  two  dimensional  layer  of  interconnected  neurons.  Each  node  in  the  two  dimensional  Kohonen 
net  corresponds  to  a  neuron  and  is  associated  with  a  set  of  weights.  The  weights  correspond  to  the 
strength  of  the  connection  between  the  inputs  and  each  node,  and  can  alternatively  be  thought  of 
as  multi-dimensional  vectors  (in  a  hyperspace)  which  characterise  the  respective  nodes. 

For  example,  if  each  input  to  the  net  consists  of  15  components  (such  as  a  15  component  vector 
corresponding  to  a  spectral  slice  of  a  speech  waveform),  each  node  is  associated  with  15  weights. 
The  output  of  each  node,  corresponding  to  a  given  input,  is  the  summation  of  the  products  of  the 

weights  to  that  node  and  the  input  components: 

l v 

9.  =  (L1) 

j=i 

where  yi  is  the  output  of  node  i,  N  is  the  number  of  input  components,  u >,•  is  the  weight  connecting 
the  i,h  node  to  the  j,h  component  of  the  input,  and  tj  is  the  value  of  the  jth  component  of  the 
input.  For  clarity,  let  the  set  of  weights  associated  with  a  node  be  called  that  node’s  “weight 
vector”.  Figure  1.1  shows  the  relationship  between  the  nodes,  weights,  and  inputs  in  graphical 
form  for  a  net  having  four  nodes  and  two  input  components.  The  figure  includes  the  equations 
describing  a  node’s  output  as  well  as  the  weight  update  process  (described  in  detail  in  Chapter  II). 

Training  the  net  with  a  set  of  input  vectors  results  in  the  weight  vectors  of  the  nodes  approxi¬ 
mating  the  input  vectors.  Also,  the  weight  vectors  associated  with  nodes  in  localized  regions  of  the 
neural  net  tend  to  be  similar  to  one  another;  i.e.,  the  Euclidean  distances  between  weight  vectors, 
corresponding  to  a  local  region  of  the  net,  is  relatively  small. 

Another  way  to  think  of  a  Kohonen  net  is  as  a  codebook.  If  the  input  vectors  representing  time 
slices  are  thought  of  as  phonemes,  each  node’s  weight  vector  represents  a  characteristic  phoneme 
from  the  training  set.  Thus,  when  a  phoneme  is  input  to  the  net  (as  an  input  vector),  the  node 
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Figure  1.1.  A  Sample  Kohonen  Neural  Net.  The  first  Kohonen  net  in  this  system 
actually  has  225  nodes  (in  a  15  by  15  array)  and  15  inputs. 


(i)  whose  weight  vector  represents  that  phoneme  will  have  the  largest  output  (y,).  Obviously,  each 
weight  vector  is  just  one  of  the  codes  from  a  codebook. 

Trajectories.  After  a  net  is  trained  with  an  utterance  representative  of  the  vocabulary  to 
be  recognized  (by  repeating  the  utterance  many  times),  the  net  is  ready  to  characterize  speech. 
Given  an  input,  only  one  node  of  the  net  most  closely  resembles  the  input.  Thus  a  sequence  of  time 
slices  or  vectors  generate  a  trajectory  through  the  neural  net,  with  each  point  on  the  trajectory 
corresponding  to  the  node  most  closely  resembling  the  respective  input  vector. 
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Hence  a  neural  net  characterises  an  utterance  by  a  unique  trajectory.  It  is  these  trajectories, 
whether  they  correspond  to  a  single  word,  a  string  of  spoken  digits,  or  a  sentence,  which  are 
processed  to  obtain  the  content  of  an  utterance. 

The  trajectories  may  be  thought  of  as  either  pictures  of  a  complex  meandering  line  or  as 
sequences  of  two  dimensional  coordinates.  The  former  representation  suggests  using  traditional 
pattern  recognition  algorithms  for  processing  images.  The  latter  suggests  traditional  speech  recog¬ 
nition  processes  such  as  dynamic  time  warping  (DTW)  (12:263-271;  13:Ch  3,6-16)  or  state  tran¬ 
sition  mapping  (14).  This  work  examines  the  latter  processes  (DTW  in  particular)  as  well  as  the 
possibility  of  using  a  second  neural  net  to  process  the  Kohonen  net  output. 

Dynamic  Time  Warping.  A  method  is  needed  to  evaluate  the  performance  of  different 
nets.  For  this  purpose,  Ney’s  one  step  dynamic  time  warping  algorithm  (12)  is  useful.  This 
algorithm  allows  a  near  optimum  recognition  of  connected  speech  while  minimizing  errors  due  to 
word  boundaries  and  stretching  of  words  during  pronunciation. 

Running  a  standard  set  of  utterances  through  a  net  and  then  a  dynamic  time  warping  algo¬ 
rithm  characterizes  the  performance  of  the  net  (including  its  training  procedures  and  the  feature  set 
chosen  for  speech  characterization)  by  the  percentage  of  words  correctly  identified.  Doing  this  for 
several  nets  (or  feature  sets)  permits  comparison  of  the  nets  (or  feature  sets)  based  on  the  variable 
being  changed.  And  of  course,  this  algorithm  also  provides  a  version  of  the  last  step  in  a  speech 
recognition  system,  the  word  recognition  algorithm. 

Scope 

The  evaluation  and  selection  of  feature  sets,  the  neural  net  training  process,  and  the  trajectory 
processing  algorithm  are  all  based  upon  a  vocabulary  of  the  spoken  digits  zero  through  nine.  A 
set  of  standard  utterances  consisting  of  both  single  and  connected  digits  is  used  to  compare  and 
optimize  the  various  processes  in  the  system. 
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Initial  evaluations  use  the  standard  set  of  utterances  and  the  one  step  dynamic  time  warping 
algorithm  to  evaluate  both  the  feature  seta  and  the  neural  net  training  process.  Both  DTW  and  a 
second  Kohonen  net  are  evaluated  as  word  recognition  algorithms. 

Approach 

In  developing  a  system  to  recognize  connected  speech,  the  first  task  is  to  select  a  feature  set. 
Once  the  feature  set  is  selected,  alternate  training  procedures  for  the  Kohonen  net  are  evaluated. 
After  the  net  training  process  is  tuned  for  optimum  performance,  by  testing  standard  utterances 
with  DTW,  comparisons  are  made  between  likely  algorithms  to  process  the  net  trajectories  and 
provide  the  sequence  of  words  contained  in  the  input  utterances.  Algorithms  considered  include 
variations  of  dynamic  time  warping  (12;  14),  state  transition  (15),  phoneme  analysis  (16),  reduced 
phoneme  trajectories  (17),  fuzzy  set  analysis  (18),  and  a  second  neural  net.  Time  considerations 
limited  tests  to  dynamic  time  warping  and  a  second  Kohonen  neural  net. 

During  each  step,  the  evolving  system  is  evaluated  for  its  utility  in  recognizing  both  connected 
and  isolated  speech. 

Sequence  of  Presentation 

Chapter  two  presents  the  hardware  and  software  environments  used  to  digitize  and  process 
the  utterances.  Chapter  three  defines  the  speech  recognition  system  and  describes  alternatives 
that  were  evaluated.  Details  are  provided  on  each  step  and  algorithm  in  the  recognition  process. 
Chapter  four  presents  the  results  of  the  tests  on  those  versions  of  the  system  which  demonstrated 
reasonable  performance.  Results  include  tests  for  speaker  dependent,  isolated  and  connected  speech. 
Chapter  five  provides  conclusions  and  recommendations  for  further  application  and  expansion  of 
the  recognition  system.  The  Appendices  contain  additional  data  and  the  computer  programs. 


II.  Development  Environment 


Every  speech  recognition  system  requires  an  analog  to  digital  (A/D)  convertor  to  sample 
the  sound.  This  was  provided  by  a  Digisound  Professional  cartridge  attached  to  an  Atari  520 
ST  microcomputer.  The  sound  data  files  were  transferred  to  a  VAX  11/780  where  they  were  run 
through  preprocessing  and  FFT  routines. 

All  computer  programs  were  developed  on  the  VAX  11/780  in  the  C  language  under  the  VMS 
operating  system.  Most  of  the  programs  were  run  on  either  Micro-VAX  II’s  or  Ill’s. 

Sound  Sampling 

The  Digisound  Professional  digitizer  cartridge  for  the  Atari  520  ST  has  a  sampling  range  of  5 
to  40  kHz.  It  takes  eight  bits  (one  byte)  per  sample  in  either  a  normal  or  logarithmic  mode  (where 
logarithmic  mode  allows  a  greater  dynamic  range  than  the  normal  mode).  The  data  files  generated 
by  the  Digisound  software  contain  eight  bytes  of  header  information  followed  by  N  bytes  of  sound 
data,  where  N  is  the  product  of  the  number  of  samples  per  second  times  the  number  of  seconds 
of  data  recorded.  The  format  of  each  byte,  assuming  sound  data  has  positive  and  negative  values 
ranging  about  an  average  value  translated  to  zero,  has  the  negative  values  (-128  to  -1)  translated 
to  the  (+128  to  +255)  range  by  addition  of  256. 

Most  of  the  data  files  generated  for  this  work  were  sampled  logarithmically  at  16  kHz.  Normal 
mode  sampling  was  tested  on  a  small  amount  of  sound  data  and  found  to  not  significantly  affect 
the  performance  of  the  system  (at  an  early  point  in  the  system’s  development).  The  selection  of  16 
kHz  and  logarithmic  sampling  was  arbitrary,  but  assured  a  “good”  characterization  of  the  sounds. 

Software  Development 

All  software  was  developed  on  a  VAX  11/780  running  the  VMS  operating  system.  Programs 
were  developed  exclusively  in  the  “C”  language  using  the  Graphics  Kernel  System  (GKS).  The  use 


of  C  and  GKS  permits  porting  of  the  system  to  other  host  computers  with  only  minor  software 
changes.  Additionally,  all  sound  files  were  stored  on  the  VAX  11/780.  This  permitted  one  back-up 
tape  to  record  aU  essential  sound  and  program  source  files. 

The  programs  were  developed  in  a  modular  fashion.  Generally,  each  step  in  the  process  was 
tested  as  it  was  developed.  The  use  of  *.com  files  (corresponding  to  the  MAKE  utility  on  UNIX 
machines)  allowed  modular  compilation  of  routines  and  quick  linking  into  executable  modules. 

Run-Time  Environment 

Most  of  the  programs  developed  on  the  VAX  11/780  were  run  on  either  a  Micro- VAX  II  or  III. 
The  exception  to  this  was  the  transformation  of  sound  files  (*.snd)  into  files  containing  frequency 
domain  vectors  (*.trn)  and  dynamic  time  warping  routines.  These  two  sets  of  software  were  usually 
run  real-time  on  the  VAX  11/780  at  about  one  million  instructions  per  second  (1  MIP). 

All  other  software  was  usually  run  batch  (on  the  Micro-VAX  III  at  3  MIP)  or  required  GKS 
graphics  (on  the  Micro-VAX  II  at  .7  MIP).  The  software  run  on  the  Micro-VAX  machines  included 
training  and  testing  of  the  neural  nets. 

Summary 

A  concise  summation  reveals  the  Atari  520  ST  as  the  host  for  speech  digitizing  and  VAX 
machines  for  all  other  work.  Coding  was  done  in  C  using  GKS  for  graphics  and  VMS  as  the 
operating  system.  Finally,  after  identifying  hardware  and  software  used  for  development,  its  about 
time  to  describe  the  speech  recognition  system  itself. 
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The  speech  recognition  system  consists  of  a  preprocessor,  a  first  level  Kohonen  neural  net, 
post-net  processing,  and  a  word  recognition  algorithm.  The  word  recognition  algorithm  is  either 
a  dynamic  time  warping  (DTW)  algorithm  or  a  second  Kohonen  neural  net.  The  dynamic  time 
warping  algorithm  works  for  either  isolated  or  connected  speech,  while  the  second  Kohonen  neural 
net  provides  acceptable  results  only  for  isolated  speech  (with  only  limited  continuous  speech  testing 
of  the  second  Kohonen  neural  net).  Figure  3.1  diagrams  the  steps  in  the  system.  Each  step  is 
described  below  in  detail. 

Preprocessing 

This  stage  of  the  system  was  developed  before  the  word  recognition  algorithm  (see  the  section 
on  Word  Recognition  Algorithms)  and  remained  essentially  unchanged  after  the  initial  development 
period.  The  preprocessing  method  was  “frozen”  when  it  created  “reasonable”  reduced  trajectories 
(see  the  section  on  Post-Net  Processing)  through  the  first  Kohonen  neural  net.  Thus,  it  is  possible 
that  other,  possibly  simpler,  preprocessing  schemes  will  work  as  well,  or  even  enable  better  overall 
system  performance. 

The  preprocessing  was  initially  very  simple.  The  sound  data,  sampled  at  16  kHz,  was  broken 
up  into  consecutive  non-overlapping  windows  of  128  samples  each.  Each  slice  was  run  through  an 
FFT  routine  to  produce  a  set  of  64  complex  frequency  coefficients.  The  amplitudes  of  these  64 
frequencies  were  reduced  to  a  set  of  15  values  corresponding  to  15  frequency  ranges.  The  extent  of 
each  range  increased  linearly  as  the  frequency  increased.  Thus,  for  each  time  slice  of  128  samples 
a  15  component  vector,  representing  the  frequency  domain  of  the  slice,  was  produced.  The  final 
preprocessing  step  was  energy  normalization  of  each  vector  to  remove  variations  in  the  volume  of 


the  utterance. 


Figure  3.1.  The  Speech  Recognition  System.  The  second  Kohonen  net  is  de¬ 
veloped  and  tested  as  an  alternative  to  DTW  as  the  word  recog¬ 
nition  algorithm. 
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Figure  3.2.  Hamming  Windows.  The  ringing  effects  caused  by  rectangular 
windows  are  reduced  by  using  hamming  windows. 

Unfortunately,  this  initial  preprocessing  scheme  did  not  work.  However,  at  this  point,  the 
preprocessing  procedure  was  evaluated  using  untested  first  net  training  procedures  and  the  full  (not 
reduced)  trajectories  through  the  net.  Accordingly,  the  following  set  of  procedures  was  developed. 
Because  of  the  reservations  just  listed,  it  is  possible  that  this  set  provides  more  processing  than  is 
necessary. 

Windowing.  A  hamming  window  reduces  the  high  frequency  ringing  effects  that  would  be 
caused  by  sampling  speech  with  a  rectangular  window.  And,  since  the  period  represented  by  each 
time  slice  is  very  short,  the  window  length  is  increased  to  256  samples.  Thus,  each  hamming  window 
covers  16  ms.  An  overlapping  scheme  of  3.T  is  used  to  minimize  boundary  effects  of  the  hamming 
windows.  Thus,  each  16  ms  window  begins  5.3  ms  after  the  start  of  the  prior  window.  The  relation 
is  depicted  graphically  in  Figure  3.2.  Please  note  that  the  sound  envelope  is  shown  compressed  in 
time  simply  to  assure  that  the  viewer  recognizes  the  data  as  that  for  speech. 


256  Samples 


FFT 


128  Frequency 
Anpl t  tudes 


Figure  3.3.  FFT  Inputs  and  Outputs.  The  128  complex  coefficients  are  con- 
0  verted  to  positive  amplitudes;  the  phase  data  are  thrown  away. 
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Fast  Fourier  Transform.  A  typical  256  point  complex  FFT  routine  processes  each  256 
sample  hamming  window.  The  imaginary  components  of  the  input  are  set  to  zero.  The  amplitudes 
of  the  resulting  128  frequency  components  are  calculated  from  the  real  and  imaginary  outputs. 
This  array  of  amplitudes  is  passed  to  the  next  preprocessing  step.  To  complete  the  pictorial 
representation  of  preprocessing,  Figure  3.3  is  included. 

Frequency  Reduction.  To  reduce  the  time  to  obtain  trajectories,  the  128  amplitudes  are 
reduced  to  15.  In  speech,  since  there  is  less  energy  at  the  higher  frequencies,  a  nonlinear  compression 
of  the  frequencies  provides  some  equalization  of  the  spectral  amplitudes  (energies).  In  this  work, 
a  pseudo-logarithmic  (nearly  quadratic)  reduction  is  used.  In  general,  this  allows  a  one-to-one 
transformation  at  the  lower  frequencies  and  simple  summation  of  amplitudes  from  ever  larger 
groups  at  the  higher  frequencies.  It  should  be  noted  that  the  human  auditory  system  uses  an 
approximately  logarithmic  coding  of  frequencies. 

This  mapping  was  set  up  to  provide  a  15  component  vector  corresponding  to  each  time  slice 
(window)  where  each  component  on  the  average  is  of  the  same  order  of  magnitude.  Figure  3  4 
provides  some  additional  detail  on  the  actual  mapping. 
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Figure  3.4.  Frequency  Reduction.  After  reduction,  the  sounds  are  still  sepa¬ 
rable,  but  can  be  manipulated  more  quickly. 


Figure  3.5.  Average  Subtraction.  This  process  distributes  the  input  vectors 
throughout  a  15  dimensional  hyperspace — not  just  the  positive 
sector. 

Average  Subtraction.  Since  each  slice  is  reduced  to  a  15  component  vector,  a  sequence  of 
slices  can  be  thought  of  as  a  trajectory  through  a  15  dimensional  hyperspace  in  which  only  the 
positive  sector  is  used.1  By  finding  the  average  value  of  the  15  components  and  then  subtracting 
that  average  from  each  component,  the  components  become  both  positive  and  negative,  and  all 
sectors  of  the  hyperspace  are  used.  This  is  shown  in  Figure  3.5. 

Energy  Normalization.  Energy  normalization  of  the  15  component  vectors  has  two  bene¬ 
fits.  The  first  is  that  variations  in  the  loudness  of  the  speech  will  not  create  differences  in  the  same 
sound’s  vectorial  representation.  Hence  a  word  can  be  recognized  no  matter  what  its  volume — 
assuming  no  other  differences  in  pronunciation.  Figure  3.6  shows  the  normalization  process  in 
terms  of  a  unit  hypersphere. 

The  second  advantage  of  energy  normalization  is  that  neural  net  processing  of  normalized 
inputs  allows  use  of  dot  products  in  place  of  Euclidean  distance  calculations  (see  Equation  1.1). 

1  Each  frequency  amplitude  resulting  from  an  FFT  is  defined  as  a  positive  value.  And  sums  of  these  amplitudes 
are  assigned  to  the  IS  components  of  each  vector.  Thus  all  components  of  the  vectors  are  positive.  The  positive 
sector  in  a  hyperspace  contains  all  of  those  vectors  and  is  simply  that  region  where  all  the  coordinates  of  a  point  are 
positive. 
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Figure  3.6.  Energy  Normalization.  Variations  in  volume  are  removed  when 
each  slice  is  normalized  to  one. 

This  improves  the  speed  of  net  training,  testing,  and  use. 

First  Level  Kohonen  Neural  Net 

Preprocessing  produces  a  file  that  consists  of  a  sequence  of  normalized  15  component  vectors. 
Each  of  these  vectors,  when  applied  to  a  Kohonen  neural  net,  will  “light  up”  a  node.  A  node  is 
defined  as  “lighting  up”  when  the  distance  between  the  node’s  weight  vector  and  the  input  vector 
is  smaller  than  the  distance  between  any  other  node’s  weight  vector  and  the  input  vector.  Hence,  a 
sequence  of  input  vectors  (corresponding  to  the  slices  of  an  utterance)  is  represented  by  a  trajectory 
of  nodes  lighting  up. 

Training.  To  get  trajectories  to  use  as  templates  for  known  words  or  as  representations  of 
unknown  utterances,  one  must  first  have  a  trained  net.  The  purpose  of  training  the  net  is  to  get 
a  two  dimensional  representation  of  the  15  dimensional  space  which  produces:  (a)  very  similar 
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trajectories  for  different  utterances  of  the  same  word,  and  (b)  significantly  different  trajectories  for 
utterances  of  different  words.  If  these  two  requirements  are  not  met,  word  recognition  will  not  be 
successful. 

Size.  But  what  size  net  can  meet  these  requirements?  Since  the  vocabulary  is  the 
digits  zero  through  nine,  the  number  of  significantly  different  sounds  in  those  words  should  dictate 
the  size  of  the  net.  Using  an  arbitrary  set  of  phonemes  (sounds),  the  ten  digits  were  broken  up  into 
combinations  of  about  20  different  phonemes.  Assuming  each  region  on  the  neural  net  corresponds 
to  a  phoneme,  and  assuming  the  reasonable  size  of  a  region  is  9  nodes  (to  allow  variations),  the 
desired  rectangular  net  has  at  least  180  nodes.  This  allows  9  versions  of  each  of  the  20  phonemes 
and  theoretically  accounts  for  most  differences  in  pronouncing  the  same  word.  Thus,  to  allow 
margin  for  background  noise  in  the  training  input  data,  the  net  was  chosen  to  be  15  by  15  (a  total 
of  225  nodes)  with  15  weights  per  node. 

Initialization.  The  weights  for  each  node  are  initially  assigned  random  values  between 
-0.05  and  +0.05.  Since  the  inputs  are  normalized  to  unit  energy,  the  average  input  component 
(corresponding  to  a  weight)  is  *,,«„«  =  =  ±0  258. 

Training  Cycles.  The  actual  training  of  the  net  requires  applying  an  input  (a  15 
component  vector)  and  updating  the  node’s  weights.  This  cycle  is  done  repeatedly.  The  actual  input 
vectors  are  chosen  sequentially  from  an  utterance  which  contains  the  spoken  digits,  in  sequence, 
with  brief  pauses  between  words.  When  the  number  of  training  cycles  is  greater  than  the  number 
of  vectors  (slices)  in  the  training  utterance,  the  training  utterance  vectors  are  simply  applied  again. 
The  final  nets  were  trained  between  90,000  and  150,000  iterations  (cycles).  In  analyses  of  early 
tests,  most  of  the  weight  changes  were  accomplished  within  the  first  10,000  iterations. 

Random  application  of  the  vectors  and  random  application  of  the  words  were  also  tried,  but 
resulted  in  no  improvement  in  recognition  accuracy. 


Neighborhood*.  As  previously  described,  when  an  input  vector  is  applied,  a  node 
lights  up.  During  any  training  cycle,  oulg  the  weights  of  those  nodes;  in  a  neighborhood  about  the 
node  that  lit  up,  are  updated.  Of  course,  the  neighborhood  includes  the  node  that  lit  up. 

Neighborhoods  are  rectangular3  in  shape,  and  are  truncated  (where  applicable)  at  the  edge 
of  the  net.  Neighborhoods  are  specified  by  their  radius  (or  half  their  length  and  width).  Thus  a 
neighborhood  specified  as  ‘4  3’  actually  includes  an  array  of  nodes  sized  9  by  7.  A  typical  training 
process  on  a  15  by  15  net  running  90,000  iterations  starts  with  neighborhoods  sized  '7  7’  and 
linearly  reduces  them  to  ‘1  1*  at  iteration  number  20,000.  Thereafter,  the  neighborhoods  stay  at  a 
constant  ‘1  1’. 

In  the  training  processes  used  here,  neighborhoods  are  never  reduced  to  only  the  node  which 
lit  up.  Since  the  minimum  neighborhood  includes  the  nearest  neighbors,  weights  in  complete  regions 
(nine  nodes)  will  be  adjusted  during  all  training  cycles. 

Gains.  A  gain  curve  specifies  how  much  the  weights  of  each  node  are  changed  during 
each  training  cycle  (within  the  specified  neighborhood).  Outside  of  the  neighborhood,  node  weights 
are  not  changed.  Typical  gain  curves  are  piecewise  linear  in  two  sections.  For  example,  the  gain 
might  start  at  0.1  and  reduce  linearly  to  0.0  at  20,000  iterations.  Thereafter  it  might  reset  to  0.01 
at  20,001  iterations  and  reduce  linearly  to  0.00  at  90,000  iterations. 

The  actual  equation  used  to  update  a  weight  within  the  given  neighborhood  is: 

+  1)  «  wj j(t)  +  a(<)(*i(0  -  wij(t))  (3.1) 

where  u>  is  the  weight  connecting  node  »  to  the  j,h  component  of  the  input  x,  t  is  time  (or  cycle), 
and  a  is  the  gain. 

Conscience.  While  training  a  Kohonen  neural  net  as  described  above,  one  usually 

finds  that  several  nodes  in  the  net  (during  the  training  cycle)  are  not  often  lit  up  by  the  inputs. 

3  Although  the  software  allows  neighborhoods  to  be  rectangular,  all  of  the  nets  in  this  effort  were  trained  using 
square  neighborhoods. 
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ThU  results  in  under-training  of  certain  nodes  and  a  corresponding  under-utilization  of  the  same 
nodes  during  later  use  of  the  net.  Specifically,  the  possible  set  of  trajectories  representing  the 
chosen  vocabulary  will  never,  or  seldom,  include  some  of  the  nodes. 

ThU  U  a  problem  only  if  different  classes  (regions  in  the  15  dimension  hyperspace  representing 
different  sounds)  tend  to  be  pushed  together  in  a  region  of  the  net,  not  allowing  sufficient  resolution 
for  adequate  speech  recognition. 

One  possible  cure  for  such  a  problem  U  applying  “conscience” .  The  name  is  derived  (rumor 
has  it)  from  the  assumption  that  given  a  large  enough  set  of  random  inputs,  any  node  should  light 
up  with  equal  probability.  Supposedly,  the  net  training  routine  U  “bugged”  when  this  does  not 
occur  and  thus  activates  its  “conscience” . 

The  version  of  conscience  used  here  U  simple.  It  assumes  that  during  training,  the  inputs 
should  have  lit  up  each  of  the  nodes  about  an  equal  number  of  times  at  every  cycle  of  the  training 
process.  Thus,  when  the  program  is  searching  through  the  225  nodes  to  find  the  one  that  lights  up 
(for  each  cycle),  it  does  not  consider  those  nodes  which  have  already  been  lit  up  too  often.  The 
routine  specifically  uses  the  following  equation  for  eligibility  of  the  node: 

c,(<)  <  0-  (3.2) 

fl 

where  c  is  the  number  of  times  node  »  has  been  lit  up  prior  to  time  (cycle)  t ,  n  is  the  total  number 
of  nodes,  and  0  is  a  conscience  factor  (usually  1.5). 3  If  the  consci*-  factor  is  changed  to  any 
number  much  greater  than  1.5,  the  program  effectively  implements  no  conscience.  If  Equation  3.1 
is  true  for  a  given  node,  it  is  eligible  for  consideration  as  the  closest  node  to  that  input. 

Use.  After  the  net  is  trained,  it  is  ready  for  use.  Using  a  net  is  the  same  whether  the  desired 
output  is  the  trajectory  for  a  template  (a  known  utterance)  or  an  unknown  utterance  A  sequence 
of  15  component  vectors,  prepared  by  preprocessing,  is  presented  one  at  a  time  as  input  to  the 

3 Not*  that  even  if  a  node  is  not  eligible  as  the  closest  node  to  a  given  input,  its  weight  vector  will  still  be  updated 
if  it  is  within  the  neighborhood  of  the  node  that  did  light  up.  When  a  node’s  weight  vector  is  updated  this  way,  the 
value  of  c,  is  not  incremented. 
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net.  The  resulting  sequence  of  nodes  that  light  up  is  the  output — a  trajectory.  The  length  of  the 
trajectory  equals  the  number  of  slices  (windows)  generated  in  preprocessing. 

Depending  on  the  use  of  the  output,  the  nodes  are  identified  either  as  an  x-y  coordinate  pair 
or  as  a  scalar.  When  the  x-y  representation  is  used,  the  range  of  both  x  and  y  is  0  to  14-  When 
the  nodes  are  represented  as  scalars  they  range  from  0  to  224  with  0  to  14  assigned  to  the  first  row 
of  nodes  and  210  to  224  assigned  to  the  last  row. 

Post-Net  Processing 

After  a  trajectory  is  generated  it  can  be  input  to  a  word  recognition  algorithm  such  as  DTW 
or  a  second  Kohonen  neural  net.  However,  examination  of  typical  trajectories  suggests  that  some 
post-net  processing  be  applied  prior  to  using  a  trajectory  as  input  to  a  word  recognition  algorithm. 

Rationale.  One  expects  the  trajectory  to  stop  at  certain  places  on  the  net  for  periods  of 
time.  Such  pauses  in  the  trajectory  should  correspond  to  the  pronunciations  of  distinct  vowel 
phonemes4  within  each  word.  Of  course,  because  of  the  dynamic  nature  of  human  speech,  one 
would  expect  a  given  phoneme  to  wander  within  a  region  of  the  net  (assuming  the  net  trained  each 
phoneme  to  a  specific  region).  And  if  the  net  trained  any  given  phoneme  to  more  than  one  region 
of  the  net,  a  trajectory  might  pause  either  on  multiple,  non-adjacent  regions  during  a  phoneme’s 
pronunciation  or  on  different  regions  during  different  utterances  of  the  same  word.  But  in  any  case, 
the  expected  trajectory  is  a  sequence  of  pauses  at  certain  locations  with  transitory  jumps  between 
those  pauses.  This  is  observed.  Since  the  transitory  jumps  between  pauses  are  inconsistent  between 
different  utterances  of  the  same  word,  one  expects  their  elimination  to  improve  accuracy. 

Method.  The  actual  implementation  requires  two  passes  through  a  stored  trajectory.  If  any 

point  on  the  trajectory  is  not  within  two  node  units  (using  the  x-y  coordinate  pair  representation) 

of  another  point  on  the  trajectory  within  two  time  slices  in  either  direction,  it  is  eliminated.  In  the 
4  Even  if  the  phoneme*  are  arbitrarily  defined. 
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second  pass,  all  points  on  the  trajectory  which  are  not  part  of  three  consecutive  points,  each  point 
within  two  node  units  of  the  others,  are  eliminated. 

This  procedure  leaves  only  those  points  on  the  trajectory  that  pause  in  a  given  phoneme 
region  for  at  least  26.6  ms  (three  overlapping  time  slices).  Phoneme  regions  sized  differently  than 
two  node  units  were  not  tested.  This  processed  trajectory  is  called  a  “reduced  trajectory”. 

Tests  were  run  on  both  the  full  trajectory,  the  reduced  trajectory,  and  a  reduced  trajectory 
with  consecutive  pauses  at  any  particular  node  reduced  to  one  point  on  the  trajectory.  The  second 
form  (the  reduced  trajectory)  performed  best.* 

Word  Recognition  Algorithms 

Two  generic  types  of  word  recognition  algorithms  were  developed.  The  first  was  an  imple¬ 
mentation  of  Ney’s  one  pass  dynamic  time  warping  algorithm  (DTW)  (12).  This  DTW  algorithm 
permits  recognition  of  either  isolated  or  connected  digits.  Unfortunately,  it  is  rather  time  consum¬ 
ing.  Thus,  a  second  Kohonen  net  was  also  developed  to  recognize  words.  The  second  Kohonen 
net  can  recognize  isolated  words,  but  does  not  approach  the  performance  of  DTW  in  recognizing 
continuous  speech. 

Dynamic  Time  Warping.  Ney’s  one  pass  dynamic  time  warping  (12)  was  adapted  almost 
unchanged  using  the  output  of  the  first  Kohonen  net.  The  significant  changes  are  the  much  simpler 
inputs  (trajectories),  testing  of  the  “stretch”  factors,  and  adapting  the  routine  to  test  a  set  of 
standard  utterances  automatically. 

Description.  Although  significant  memory  can  be  saved  by  coding  shortcuts,  it  is 

easiest  to  describe  the  algorithm  by  thinking  of  one  large  array.  Figure  3.7  shows  a  simplified  view 

of  a  completed  array.  Assign  to  each  column  one  vector  or  time  slice  of  the  utterance  under  test. 

In  the  process  here,  that  vector  is  an  x-y  coordinate  pair  corresponding  to  a  point  on  the  reduced 
5See  Figures  <.3  through  4.5  for  examples  of  full  and  reduced  trajectories  and  the  reduction  process. 
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trajectory.  The  first  column  is  assigned  the  first  vector,  the  last  column  the  last  vector.  To  each 
row  is  assigned  a  vector  from  one  of  the  11  templates.  The  templates  are  typical  utterances  of  the 
ten  digits,  one  each,  and  a  short  period  of  background  noise  (silence).  Thus,  the  first  vector  of  the 
digit  zero  is  assigned  to  the  bottom  row  and  the  last  vector  of  the  trajectory  for  silence  is  assigned 
to  the  top  row.  Silence  is  included  since  it  is  part  of  any  recording  of  natural  speech.  Using  a 
template  for  silence  alleviates  the  need  for  trimming  such  periods  from  a  digitized  recording. 

To  explain  DTW  and  how  the  array  is  processed,  first  assume  a  simplified  array  with  only  one 
template  (e.g.,  a  two)  and  an  utterance  to  be  identified  which  also  happens  to  be  a  two.  Vectors 
from  the  two  trajectories  are  assigned  to  the  rows  and  columns  of  an  array.  The  size  of  the  array 
obviously  depends  on  the  lengths  of  the  trajectories.  Fill  in  the  array  by  assigning  to  each  element 
the  distance  between  the  vectors  assigned  to  that  element’s  row  and  column.  Now,  if  both  words 
were  spoken  identically,  the  diagonal  would  be  filled  with  zeros. 

Of  course,  the  same  word,  spoken  twice  by  the  same  person  can  be  either  longer  or  shorter,  and 
generally  is  stretched  non-uniformly  throughout  the  utterance.  The  DTW  algorithm  tries  to  find 
the  best  possible  match  between  two  words  despite  such  stretching.  To  do  so,  the  algorithm  starts 
at  the  bottom  left  element  of  the  distance  array  (just  generated)  and  finds  the  shortest  cumulative 
path  to  the  upper  right  element.  Any  path  can  go  diagonally  (the  theoretical  best  match),  right 
one  element  (utterance  stretched  more  than  template),  or  up  one  element  (template  stretched  more 
than  the  utterance).  Factors  are  assigned  to  each  of  these  directions  which  show  preference  for  the 
direction  and  amount  of  stretch  expected  by  the  programmer.  Figure  3.8  demonstrates  this  process 
with  two  short,  hypothetical  twos. 

Thus,  the  cumulative  minimum  path,  V ,  is  assigned  a  value  according  to  the  following  equa¬ 
tions: 

V  =  min(6),  =  min(^yJ  dr,e)t  (3.3) 

where  V  represents  the  best  match  between  the  two  trajectories,  «  represents  all  possible  paths 
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Figure  3.7.  DTW  Array.  The  problems  caused  by  stretching  and  word 
boundaries  are  handled  efficiently  in  a  one-pass  dynamic  time 
warping  algorithm. 
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Figure  3.8.  A  Simplified  DTW  Example.  This  simple  problem  shows  how  the 
basic  routine  works  when  the  utterance  under  test  is  compared 
to  only  one  template. 


* 


through  the  distance  array,  yj  is  a  coefficient  depending  on  which  of  the  three  possible  directions, 
j,  is  chosen  (usually  1,  0.75,  and  0.75  for  diagonal,  right,  and  up),  and  dr,c  is  the  distance  between 
vectors  assigned  to  row  r  and  column  c.  If  values  of  V  are  found  for  a  given  unknown  utterance 
when  compared  to  each  of  the  11  templates  (in  11  arrays),  the  unknown  utterance  is  probably  the 
word  represented  by  the  template  with  the  smallest  V. 

In  the  simple  case  where  one  unknown  word  is  compared  to  one  template  (doing  this  eleven 
times),  the  coding  to  find  V  is  simple.  Just  start  at  the  bottom  of  the  left  column  of  the  dis¬ 
tance  array  and  proceed  upwards-column  by  column.  As  each  element  in  the  array  is  reached,  a 
cumulative  minimum  partial  path  value  is  assigned  to  the  same  element  of  a  different  array  (of 
the  same  size).  The  partial  path  value  is  found  by  adding  the  distance  assigned  to  that  element 
(multiplied  by  the  appropriate  stretch  factor)  to  the  minimum  value  chosen  from  the  partial  values 
calculated  for  the  elements  to  the  left,  diagonal,  or  down  directions.  Thus,  the  value  of  V  is  just 
the  cumulative  minimum  partial  path  value  of  the  top  right  element. 

When  the  unknown  utterance  contains  connected  digits,  the  process  is  slightly  more  compli¬ 
cated  and  the  array  of  Figure  3.7  must  be  used.  The  same  column  by  column  calculations  are  made 
(proceeding  upward  through  each  column),  but  special  rules  take  effect  as  template  boundaries  are 
crossed.  When  a  boundary  is  reached,  one  assumes  either  a  word  just  ended  or  else  stretch  is  occur¬ 
ring  in  the  existing  word.  Thus,  at  the  first  row  after  each  template  boundary,  the  minimum  partial 
value  is  chosen  from  the  elements  corresponding  to  the  last  row  of  each  template  (words  ended)  in 
the  prior  column,  and  the  element  just  to  the  left  of  the  one  under  consideration  (stretching  of  the 
word).  Finally,  one  must  also  assume  that  the  end  of  the  trajectory  for  the  utterance  under  test 
corresponds  to  the  completion  of  a  digit  (or  silence). 

To  find  the  contents  of  an  utterance,  the  minimum  path  through  the  array  is  traced  from  the 
upper  right  element  to  the  tower  left,  tracing  out  the  various  templates  as  the  path  progresses.  As 
mentioned  earlier,  there  are  coding  schemes  which  do  not  require  saving  more  than  two  rows  of 
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pointers  and  two  columns  of  partial  path  values  at  any  one  time.6 


Stretch  Factors.  The  stretch  factors  assigned  to  the  three  path  directions  seem  to 
have  a  large  impact  on  the  success  of  recognizing  both  isolated  and  connected  digits.  The  greatest 
success  was  found  when  factors  of  1.0,  0.75,  and  0.75  were  assigned  to  the  diagonal,  right,  and  up 
directions,  respectively.  This  differs  from  Ney’s  suggested  values  of  1.0,  2.0,  and  0.5.  The  best 
values  actually  depend  on  the  specific  utterances  used. 

Automatic  Scoring.  As  previously  mentioned,  a  set  of  standard  utterances  and  tem¬ 
plates  are  used  to  evaluate  the  success  of  particular  versions  of  the  system.  To  minimize  the 
operator’s  efforts,  an  automatic  scoring  routine  was  developed. 

A  scoring  DTW  array  is  used  where  sequences  of  digits  are  assigned  to  the  rows  and  columns. 
For  example,  if  the  utterance  is  known  to  be  the  words  1-2-3,  those  integer  values  are  assigned  to 
the  three  rows  of  the  DTW  array.  After  running  through  the  DTW  process  described  earlier,  the 
utterance  might  be  found  to  be  1-2-4.  Thus,  1,  2,  and  4  are  assigned  to  the  three  columns  of  the 
scoring  DTW  array.  The  distances  assigned  to  each  element  are  either  zero  or  one.  Zero  is  chosen 
if  the  row  and  column  match;  one  if  they  do  not.  Figure  3.9  shows  this  example. 

The  stretch  coefficients  are  set  to  1.0,  0.5,  and  1.0  for  diagonal,  right,  and  up  directions.  In  the 
scoring  DTW  array,  these  correspond  to  a  match  that  is  a  substitution  (or  correct),  an  insertion,  or 
a  deletion.  Therefore,  when  V'  is  calculated  it  becomes  the  number  of  errors.  Knowing  the  number 
of  actual  digits  in  the  utterance  allows  calculation  of  the  percentage  correct. 

Second  Kohonen  Neural  Net.  Obviously,  the  computation  time  needed  to  use  a  DTW 
algorithm  increases  in  direct  proportion  to  the  size  of  the  vocabulary  (number  of  templates)  to 
recognize.  In  an  attempt  to  reduce  computation  time,  a  second  Kohonen  neural  net  was  evaluated 
as  an  alternative  to  the  DTW  algorithm. 

8See  the  routine  “cdtw"  in  the  program  "autodtw"  in  Appendix  B.  page  B-48. 
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(2)  Stretch  Factors 
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(3)  Cumulative  Minimum  Paths 
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The  cumulative  minimum  path  to  the  upper 
right  element  Is  the  number  of  errors 


Figure  3.9.  DTVV  Used  for  Scoring.  This  example  shows  how  DTVV  is 
adapted  to  automatically  score  the  results  of  a  lest  of  connected 
speech  recognition. 
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Inputs.  Because  DTW  works  well  on  reduced  trajectories,  the  “reduced  trajectory” 
contains  enough  information  to  identify  words.  But  trajectories  vary  in  length  and  cannot  be  energy 
normalized  without  destroying  the  information. 

Thus,  the  first  form  of  input  considered  was  simply  a  set  of  225  values  corresponding  to  the 
225  nodes  of  the  first  net.  Each  value  is  the  number  of  times  the  trajectory  hit  that  node.  The 
second  idea  is  not  as  simple,  but  includes  more  information  in  the  input  vector.  When  a  slice 
(vector)  is  input  to  the  first  net,  it  produces  an  activation  surface  identified  by  225  values  (the 
dot  product  of  the  input  vector  with  the  node’s  weight  vector  for  each  node).  Summing7  these 
surfaces  produces  a  composite  surface  which  might  have  local  maxima  where  the  trajectory  paused 
longest.  Both  forms  of  input  can  be  normalized.  However,  they  inherently  do  not  contain  the 
time  dependent  information  in  the  trajectories.  Success  was  not  achieved  using  either  of  these 
techniques. 

Alternate  forms  of  input  vectors  which  retain  the  time  dependency  are  either  a  set  of  200 
values  corresponding  to  100  x-y  coordinate  pairs  or  100  values  corresponding  to  100  scalars.  Both 
sets  of  values  are  simply  “reduced  trajectories”  through  the  first  net.  The  vast  majority  of  isolated 
digits  produce  reduced  trajectories  of  less  than  100  points.  When  the  trajectory  lengths  are  less 
than  100  points,  both  of  the  alternate  forms  of  input  vectors  are  filled  with  —  l's  to  maintain  a 
constant  length  input.  Both  of  the  alternate  forms  were  reasonably  successful. 

Size.  The  desired  output  is  either  one  of  the  10  digits  or  silence;  that  is.  eleven  words. 
Assuming  some  variation  in  the  words,  regions  of  nine  nodes  should  adequately  represent  each  word. 
Thus  a  net  of  10  x  10  nodes  provides  more  than  the  99  nodes  desired.  The  number  of  weights  in 
a  node’s  weight  vector  is  either  100  or  200  depending  on  the  form  of  input  selected  (scalar  or  x-y 
pair). 

‘Summing  two  surfaces  simply  adds  the  height  at  any  point  on  one  surface  to  the  height  at  the  corresponding 
point  on  the  second  surface. 
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Training.  Training  is  very  similar  to  that  of  the  first  net.  The  biggest  difference  is 
that  here  the  number  of  training  input  vectors  is  the  same  as  the  number  of  nodes.  In  the  first  net, 


the  number  of  inputs  was  almost  an  order  of  magnitude  larger  than  the  number  of  nodes. 

Additionally,  initial  weights  are  randomly  assigned  from  sets  consisting  of  the  integers  from 
0  to  225  (where  the  inputs  are  100  scalars)  or  0  to  14  (where  the  inputs  are  100  x-y  coordinate 
pairs).8 


Traditional  Training.  Two  sets  of  training  inputs  were  selected  and  used  for 
various  nets.  The  first  of  these  was  a  set  of  100  words,  10  each  of  the  10  digits.  The  second  was  a 
set  of  91  words,  9  each  of  the  10  digits  and  1  example  of  silence. 

Training  runs  included  cases  for  no  conscience  as  well  as  conscience  factors  of  1.1  and  1.5.  To 
account  for  the  decreased  eligibility  of  nodes  during  training  with  conscience,  the  training  process 
was  increased  to  150,000  cycles. 

Upon  completion  of  each  net’s  training,  the  set  of  training  inputs  was  applied  to  the  trained 
net.  With  no  conscience,  only  about  58%  of  the  nodes  light  up.  This  implies  a  need  for  conscience 
in  training  the  second  net. 

Finally,  there  is  an  obvious  question  implied  by  training  a  net  with  100  scalar  inputs.  The 
nodes  are  made  to  reflect  the  inputs  by  pulling  their  weights  towards  the  input  components.  But 
two  points  on  a  trajectory  can  be  adjacent  nodes  on  the  first  net  while  being  15  units  apart  on 
the  scalar  input  representation.  Thus,  can  the  existing  training  process  be  effective  in  overcoming 
those  15  unit  discontinuities? 

Abbreviated  Training.  Clearly,  using  a  second  net  is  little  more  than  select¬ 
ing  a  set  of  codebook  trajectories.  As  such,  does  one  expect  training  to  generate  100  codebook 

trajectories  that  are  better  than  an  arbitrary  100  original  trajectories  (10  each  of  the  10  digits)7 

8Note  that  when  scalar  inputs  are  used,  both  the  scalar  input  components  and  the  initial  node  weights  are  seeded 
by  to  keep  the  values  in  the  reuige  of  zero  to  one. 
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To  answer  this  question,  nets  were  generated  for  each  of  the  two  forms  of  inputs  (100  scalars 
and  100  x-y  coordinate  pairs)  without  any  training.  In  these  nets,  the  reduced  trajectories  for  ten 
examples  of  each  digit  were  assigned  directly  to  the  weight  vectors  of  each  row  of  nodes.  No  other 
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training  was  provided. 

Use  In  Isolated  Speech.  Once  a  net  is  trained,  a  digit  is  assigned  to  each  node. 
Thereafter,  when  a  reduced  trajectory  is  applied  to  the  input  of  the  net,  the  net  identifies  the  input 
as  the  digit  assigned  to  the  node  that  lit  up. 

Digits  are  assigned  to  nodes  by  comparing  the  weight  vector  of  a  node  to  the  trajectory 
representations  of  a  set  of  100  digits  (ten  each)  not  used  in  training  the  net.  The  digit  whose 
trajectory  is  “closest”  to  the  node  wins.  Finding  the  “closest”  trajectory  involves  either  Euclidean 
distance  or  performing  a  mini-DTVV. 

Euclidean  Distance.  In  this  case,  the  distances  are  simply  the  sum  of  the 
squares  of  the  differences  between  the  weights  and  input  components.  At  times,  a  TAXI  distance 
is  used  rather  than  Euclidean.  In  TAXI  space,  distance  is  the  sum  of  the  absolute  values  of  the 
differences  between  the  weights  and  the  input  components 

Dynamic  Time  Warping.  When  DTW  is  used,  the  100  scalar  trajectories  are 
converted  to  100  x-y  coordinate  pairs.  The  lengths  of  the  utterance  and  template  trajectories  are 
always  adjusted  to  eliminate  the  portion  of  the  trajectories  filled  with  trailing  -l's.  Use  of  DTW 
to  find  the  closest  digit  considers  the  variations  in  stretch  inherent  in  any  utterance. 

Use  In  Connected  Speech.  To  use  the  second  Kohonen  net  to  identify  connected 
speech,  the  same  training  and  node  assignment  procedures  are  used.  However,  the  methods  tested 
to  identify  connected  speech  used  only  DTW  to  identify  the  closest  node. 

Each  slice  of  the  utterance  under  test  is  assigned  a  digit  and  a  distance.  The  slice  in  question 
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and  the  following  99  in  the  sequence  are  used  to  generate  a  trajectory  through  the  first  Kohonen 
net.  The  trajectory  is  then  used  to  find  which  node  lights  up  in  the  second  Kohonen  net.  The 
comparison  method  here  is  DTW  where  the  template  and  utterance  (trajectory)  lengths  are  both 
assigned  the  number  of  weights  in  the  appropriate  node’s  weight  vector  which  are  not  — l’s.  The 
digit  assigned  to  the  node  which  lit  up  is  the  digit  assigned  to  the  slice.  That  slice  is  also  assigned 
a  weight  or  distance  which  is  merely  V  (the  cumulative  minimum  path  distance)  normalized  by 
dividing  it  by  the  number  of  array  elements  in  the  minimum  cumulative  path. 

Thus,  when  a  sequence  of  distances  assigned  to  a  sequence  of  slices  (i.e.  an  utterance)  has 
an  obvious  local  minima  (one  that  lasts  for  more  than  about  50  ms  and  is  at  least  100  ms  from 
another  minima),  it  is  assumed  that  the  utterance  begins  a  new  digit  at  that  point.  In  particular, 
it  begins  the  digit  assigned  to  that  slice.  In  turn,  the  sequence  of  digits  assigned  to  the  sequence 
of  local  minima  is  interpreted  as  the  content  of  the  utterance  under  test. 

Summary 

This  chapter  has  described  in  detail  the  speech  recognition  system  developed  in  this  effort 
The  description  included  preprocessing  of  the  digitized  speech,  training  of  the  first  Kohonen  net 
for  production  of  trajectories,  processing  those  full  trajectories  to  eliminate  transitory  points,  and 
evaluating  the  reduced  trajectories  by  either  a  DTW  algorithm  or  a  second  Kohonen  neural  net  to 
obtain  the  content  of  an  utterance.  At  no  time  was  any  attempt  made  to  quantify  the  performance 
of  the  system9 — that  data  was  saved  for  the  next  chapter. 


c 


9  Although  at  times  it  was  necessary  to  verify  some  hypothesis  or  state  that  some  procedure  did  or  did  not  work. 
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First  Kohonen  Neural  Net 

An  ideally  trained  Kohonen  net  should  place  inputs  from  a  given  class  within  the  same  region 
(group  of  nodes).  Is  it  possible  to  tell  whether  this  result  is  obtained  just  by  looking  at  a  net?  To 
some  extent,  yes.  Figure  4.1  displays  the  net  “speakl”.  Each  of  the  225  nodes  is  represented  by 
its  weight  vector,  shown  as  a  small  spectrum.  The  spectrum  is  simply  the  15  weights  drawn  as 
vertical  bars.  It  is  easy  to  see  that  various  regions  of  the  net  have  similar  spectra,  and  the  changes 
between  adjacent  nodes  are  very  graceful. 

“Speakl”  was  trained  with  no  conscience.  Figure  4.2,  “speaklO”,  was  trained  with  a  con¬ 
science  factor  of  1.5.  Again,  one  observes  that  within  a  region,  the  node  spectra  are  very  similar.  In 
fact,  without  prior  knowledge,  there  is  no  way  visually  to  tell  that  conscience  was  used  in  training 
“speaklO”  and  not  in  “speakl”.  This  is  expected.  It  shows  that  training  has  occurred,  but  does 
not  show  whether  a  net  will  be  successful  in  producing  identifiable  trajectories. 

Trajectories 

Trajectories  can  be  viewed  either  graphically,  or  as  a  sequence  of  integers  representing  the 
225  nodes.  Figure  4.3  graphs  a  full  trajectory  for  the  word  zero.  Figure  4.4  shows  the  reduced 
trajectory  of  the  same  word.  Figure  4.5  shows  the  reduction  process  from  a  full  trajectory  to  a 
reduced  trajectory  as  a  printout  of  integers  (each  integer  one  of  the  225  nodes).  The  graphs  contain 
the  number  of  the  slice  which  lights  up  a  node  in  the  rectangle  representing  that  node.  If  a  node  is 
lit  up  more  than  once,  only  the  last  slice  number  is  identified  and  three  asterisks  are  added  to  the 
rectangle.  Note  that  slice  numbers  are  only  “effective”  values  for  the  reduced  trajectories 

Appendix  A  shows  the  reduced  trajectories  for  the  templates  (the  digits  zero  through  nine 
and  silence)  used  in  the  DTVV  algorithm.  When  comparing  the  eleven  templates  they  appear 
separable — even  to  the  eye. 


»w  A,  A»  >L  i.  *L  *»  AJ A„ !«,  J*,  It,  v Jt, 

U<-|LJL1L*«JLC^ii-CUULU 

|  uuu«LCa-jua-UCCLLLL 

JUuutju^utwLCCLWLL 

WVJVjuuuujuuUCCULU 

yj  /fj  vJ  M-J  M*1  Mr  ^wm-  Lr 

nr ^  %M JrM  V^  ^i*r*  ^■•'  ^»«r  ^*W 

(J^vJ^UU^OCUL-U'UiViV 

i  .*M  *^M  iXj  My  My  My  My  My  t*M  t*M  tpj 
i^  «M  -wJ  -»J  »M  »-J  M^  My  My  My  Mr  My  ^»M  ^»M  SM 

n**  -d  -M  irM  nO  d^  My  Mr  Mr  Mr  ^  *riM 


Figure  4.1. 


Net  Speakl  Trained  with  No  Conscience.  Note  the  regional  similarities 
and  the  gradual  change  from  node  to  node  and  region  to  region. 
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t»,  t^r  t^  t»  t>»  t^  t«w  tv  t»  k»  -  v-J  ( |^>d 
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LLLLLLLwcLU — UJ 

^  ■  L»  li»  Lr  Lw  tv  tv  tv  'wi  »»i  )■  i  ^ 

m,  i.^  tr»  t-v  L  tvr  t v  **V»'  U-1  ^  ’-j  vj  ^  « J 

UL.I^LUwivtvtvU'OJJJJ 

^t.it,)t,it,i4fa,i,v'vtuuu^^fX' 

Ju  ■t,  ^  ^  H,  X  <-v  ^  ^  v  U  uj  ^  *X-  ^ 


Figure  4.2,  Net  Speak  10  Trained  with  Conscience  =  1.5.  Without  prior  knowl¬ 
edge,  there  is  no  way  to  visually  determine  the  amount  of  conscience 
used  to  train  a  net. 
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Figure  4.3.  Full  Trajectory  of  the  Word  Zero.  The  numbers  represent  the  last 
time  slice  to  light  a  node.  When  a  node  is  lit  more  than  once,  three 
asterisks  are  printed. 
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Reduced  Trajectory.  zero5  trn  -->  epeaK10.net 


Figure  4.4.  Reduced  Trajectory  of  the  Word  Zero.  Transitory  points  not  near 
other  points  are  eliminated.  The  “slice”  numbers  shown  are  actually 
the  respective  location  of  a  lit  node  in  the  reduced  trajectory.  Note 
the  much  simpler  curve  when  the  trajectory  is  reduced. 
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rercS.trn  -->  spealilO.net 
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Figure  4.5.  Reduction  Process  for  the  Word  Zero.  Each  point  in  a  trajectory 
represents  a  node.  “0”  is  the  upper  left  node,  “14"  is  the  upper  right, 
and  “224"  is  the  bottom  right  node. 
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Table  4.1.  Presentation  of  Inputs 


Net 

Process 

Connected  Words 

speak  1 

sequential 

957 

7591 

speakS 

random 

907 

737 

speak! 

random  word 

lOuVi 

56‘X 

Note  Because  sequential  training  resulted  in  overall  best 
performance,  it  is  used  to  train  all  later  nets. 


Dynamic  Time  Warping 

Dynamic  time  warping  tests  were  performed  over  a  long  period  of  time  Tlie  earliest  tests 
used  a  smaller  set  of  test  words  and  in  general  evaluated  different  aspects  of  the  system  Kacli 
evaluation  is  described  below 

Training  Process.  One  of  the  first  uses  of  DTW  was  to  evaluate  the  first  kohonen  net's 
training  In  this  instance,  the  DTW  testing  was  not  yet  automated  Ten  arbitrary  digits  were 
used  for  templates  Ten  different  digits  were  used  to  test  for  isolated  speech  recognition,  and 
eight  utterances  of  connected  digits  (containing  another  48  digits)  were  used  to  lest  for  continuous 
speech  recognition  The  connected  digits  at  this  point  were  intentionally  slurred  together  as  much 
as  possible  The  DTW  stretch  factors  were  set  at  10.  0.5.  and  0  5 

The  three  types  of  training  processes  evaluated  in  Table  4  1  vary  the  presentation  of  the  inputs 
to  the  net  The  first  method  takes  an  utterance  containing  all  ten  digits,  with  pauses  between  them, 
and  repeatedly  presents  the  input  vectors  to  the  net  in  their  natural  sequence  (called  sequential 
training)  The  second  method  presents  the  input  vectors  from  the  same  utterance  to  the  net  in 
a  random  sequence  (called  random  training)  The  last  method  takes  10  utterances  of  individual 
digits  and  presents  them  to  the  net  in  a  random  sequence.  Individual  vectors  within  the  randomly 
selected  word  are  presented  in  their  natural  sequence  (called  random  word  training). 

No  conscience  is  used  in  any  of  these  nets  The  sequential  training  process  appears  to  provide 
the  overall  best  performance.  The  reasons  behind  the  relative  performances  were  not  investigated 
However,  it  was  noted  that  the  random  number  generator  did  not  produce  a  very  uniform  dis- 
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T»M<>  4.2.  Comparison  of  Stretch  Factors 


Stretch  Factors 

Isolated  Words 

Connected  Words 

2.0.  0.5 

757 

807, 

1.5.  0.5 

757c 

807 

10,  10 

1007c 

737 

1  0.  0.75 

907 

807 

1.0.  0.5 

807 

847 

0.75.  0  75 

1007 

797 

0.75.  0.5 

907 

767 

0  5.  0  5 

1007 

717 

Note:  The  1007  isolated  rate  for  equal  stretch  factors 
confirms  that  isolated  words  were  spoken  at  the  same 
speed  as  the  templates.  The  connected  utterances 
were  actually  spoken  faster 

tnhution  Since  sequential  training  worked  best,  whatever  the  reason,  it  is  used  in  all  later  net 
training 

Stretch  Factor Variations  in  performance,  as  the  stretch  factors  were  changed,  was  ob¬ 
served  during  development  and  debugging  of  the  DTW  routines  This  suggests  that  additional 
testing  where  only  the  stretch  factors  are  changed,  could  provide  the  best  performance  for  the 
given  set  of  utterances 

For  the  tests  shown  in  Table  4.2,  the  best  performing  net  at  that  time,  ‘'speakl",  was  used 
Only,  the  stretch  factors  in  the  right  and  up  directions,  respectively,  are  varied.  The  diagonal 
stretch  factor  remains  1.0. 

Note  the  tradeoff  between  results  for  isolated  and  connected  speech  The  fact  that  1009c 
accuracy  is  obtained  for  isolated  speech  whenever  the  off-diagonal  stretch  factors  are  equal  implies 
that  the  isolated  words  under  test  were  spoken  at  the  same  speed  as  the  templates.  Likewise,  when 
the  stretch  factors  are  not  equal,  recognition  of  the  faster  spoken  connected  utterances  improves. 

At  this  point,  comparisons  of  the  envelopes  of  the  connected  speech  utterances  used  here 
with  those  used  by  Dawson  (13)  were  made.  It  was  found  that  Dawson  clearly  separated  his  words 
in  the  continuous  speech  utterances  For  ease  of  comparison,  a  new  set  of  connected  utterances 


4-8 


Table1  4.3.  Tests  of  Clearly  Spoken  Connected  Speech 


Stretch  Factors 

Connected  Words 

1.0.  0  5 

90 7 

0  75.  0.75 

917c 

Note:  Connected  speech  recognition 
improves  when  t  lie  words  are  spoken 
clear!}  and  are  not  slurred  together 


Table  4.4.  Conscience  in  First  Kohonen  Nets 


Net 

Conscience 

Isolated  Words 

speakl 

none 

90.07 

93.07 

speakO 

ii 

82.77 

72.17 

speaklO 

1.5 

99  17 

90  77 

Note:  A  modest  application  of  conscience  (1.5)  results  in  a 
large  improvement  in  isolated  recognition,  while  too  much 
conscience  (1.1)  degrades  performance 


were  generated  in  which  the  words  were  not  slurred  together.  The  results  from  these  tests,  using 
"speakl".  are  shown  in  Table  4  3. 

The  improved  results  are  dramatic  and  are  now  comparable  to  the  results  Dawson  obtained 
Therefore,  this  set  of  connected  utterances,  as  well  as  the  stretch  factors  of  [1.0.]  0 .75  and  0  To.  are 
used  in  all  later  tests 


Conscience.  After  finding  that  conscience  assisted  in  training  the  second  Kohonen  net  (see 
the  following  sections),  new  first  Kohonen  nets  were  trained.  Table  4.4  shows  the  results  of  DTW 
runs  on  those  nets  For  these  (and  later)  tests,  the  number  of  isolated  words  being  tested  was 
increased  to  1 10. 

Note  that  while  conscience  dramatically  helps  recognition  of  isolated  words  (when  there  is 
not  too  much  of  it),  it  also  slightly  degrades  recognition  of  connected  words.  During  the  training 
run  on  “speak9",  it  was  found  that  only  25  to  40  percent  of  the  nodes  were  eligible  each  training 
cycle  (because  of  conscience)  for  matching  the  given  input.  Given  the  accuracies  in  Table  4.4,  one 
could  infer  that  nodes  are  being  under  or  improperly  trained  with  a  conscience  factor  of  1.1 
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Template*.  Each  of  t he  prior  DTW  tests  used  }1  arbitrary  templates — one  for  each  of  the 
ten  digits  and  one  for  silence  With  the  variability  in  trajectories  between  different  instances  of  the 
same  digit,  selecting  specific  templates  might  improve  the  recognition  rate 

Thus,  unsuccessful  attempts  were  made  to  increase  accuracy  by  using  various  template  select¬ 
ing  algorithms  One  algorithm,  that  seems  quite  reasonable,  resulted  in  the  greatest  degradation 
Twenty  examples  of  each  of  the  ten  digits  were  collected  The  one  example  out  of  the  twenty  that 
had  the  lowest  average  DTW  minimum  path  to  the  other  nineteen  was  selected  as  the  template 
for  that  digit  l  sing  these  newly  selected  templates,  stretch  factors  of  0  75  and  0  75.  and  net 
"speak  10".  isolated  recognition  dropped  from  99  1%  to  94  .5%.  The  connected  digit  recognition 
rate  dropped  more — from  90  7%  to  70  77< 

A  small  amount  of  degradation  might  occur  because  of  a  change  in  relative  stretches  between 
the  templates  and  the  utterances  under  test  However,  the  connected  rate  drop  of  14%  seem- 
excessive.  Apparently,  the  tested  digits  were  not  closest  to  the  "average"  template  from  each  set 
of  20 

Sjxak-cr  Jndej>cndent  Speech  Recognition.  A  small  number  of  tests  were  performed  on 
utterances  spoken  by  someone  other  than  the  net  trainer  (the  speaker  whose  utterances  trained 
the  Kohonen  net)  A  deep  female  voice  was  used  for  these  tests;  whereas  all  other  tests  used  a 
mid-range  male  voice 

A  set  of  10  isolated  digits  and  eight  connected  digit  utterances  (containing  another  48  digits) 
were  tested  using  the  templates  in  the  male  voice,  net  “speakT”,  and  stretch  factors  of  0.75  and 
0.75.  The  results  were  a  40%  isolated  and  31.3%  connected  digit  recognition  rates.  It  is  expected 
that  if  templates  were  generated  from  the  female’s  speech,  the  results  would  improve. 


Second  Kohonen  Neural  Net 

Extensive  tests  were  run  on  a  number  of  forms  of  the  second  Kohonen  neural  net  The  driving 
motivation  was  the  possibility  of  decreasing  computation  time  and  providing  a  system  where  all 
major  components  emulated  simplified  neural  activity 

Early  Attempt ».  Limited  development  took  place  for  two  types  of  inputs  described  in 
Chapter  111  In  both  of  these,  an  input  vector  had  225  components.  In  both  cases  each  component 
represented  one  of  the  225  nodes  in  the  first  Kohonen  net  In  the  first  case,  a  component  was  (| 

incremented  (from  zero)  any  time  its  respective  node  was  lit  in  a  word's  trajectory  In  t he  second 
case,  tie  "activation  level  "  of  each  node  was  added  to  that  node’s  cumulative  activation  from  every 
input  (slice)  in  an  utterance  (Jiven  a  vector  input  to  the  first  net.  the  activation  level  for  a  node 
is  the  dot  product  of  that  node's  weight  vector  with  the  input  vector 

Die  possible  advantage  of  these  types  of  input  is  that  they  can  be  normalized,  allowing 
simple  and  fast  computations  in  using  and  training  a  net  However,  it  deletes  the  time  dependent 
relationship  of  the  various  sounds  in  a  digit 

Ninety  words  (nine  versions  of  each  digit)  were  used  to  train  these  nets  After  training,  tie 
90  words  were  input  to  the  net  and  the  nodes  that  lit  up  were  identified.  Unfortunately,  less  than 
half  a  dozen  nodes  lit  up  in  each  case  At  that  point,  these  nets  were  considered  unsuccessful,  and 
development  of  other  forms  proceeded 

Yet.  there  are  at  least  two  reasons  why  the  labeling  of  these  nets  as  unsuccessful  is  ques¬ 
tionable.  First,  it  was  later  noted  that  training  and  testing  of  the  second  Kohonen  net  took  place 
using  dot  product  algorithms  rather  than  Euclidean  distance  Since  the  inputs  at  this  point  were 
not  normalized,  dot  products  could  not  give  valid  results  Secondly,  conscience  had  not  yet  been 
implemented.  It  is  quite  possible  that  assigning  random  numbers  to  the  initial  weights  gives  only  a 
few  nodes  with  vectorial  representations  even  close  to  the  cumulative  activation  surfaces  described 
above  Both  reasons  suggest  that  some  additional  testing  might  prove  beneficial. 
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Table*  4.5.  Conscience  in  Second  Kohonen  Nets 


Net 

Conscience 

Nodes  Lit 

Differentiation 

path5 

none 

589? 

91.19? 

patlil  1 

15 

819? 

wmsmm 

path  12 

11 

899? 

98.99? 

Note:  These  results  show  that  conscience  increases 
the  effective  number  of  nodes  that  “look"  like  the 
training  inputs.  They  do  not  necessarily  imply 
comparable  performance  in  recognizing  words. 


Trajectory  input  Nets.  As  described  in  the  prior  chapter,  two  alternate  forms  of  input 
were  also  explored  These  consist  of  trajectories  represented  either  as  100  scalar  values  or  10U  x-y 
coordinate  pairs  Shorter  trajectories  are  filled  with  trailing  -l's  However,  initial  development, 
as  described  below,  used  a  75  scalar  input  (trajectory  of  length  75  or  less)  with  trailing  zeros  It 
will  later  be  seen  that  no  significant  improvement  or  degradation  in  accuracy  arises  from  switching 
between  75  and  100  point  trajectories. 


^  Conscience.  As  mentioned,  initially  a  75  point  trajectory  was  selected.  Unfortunately. 

after  training  (without  conscience),  only  about  589?  of  the  nodes  lit  up  when  the  set  of  training 
digits  were  input  In  addition,  when  looking  at  the  nodes  that  lit  up.  only  919?  of  the  90  training 
^  digits  could  be  correctly  differentiated. 

Figures  4.6  through  4  8  show  the  result  of  nets  trained  w  ith  (a)  no  conscience  (b)  a  conscience 
factor  of  1 .5.  and  (c)  a  conscience  factor  of  1.1.  Each  of  these  nets  used  75  scalar  inputs  Note  that 
)  the  numbers  represent  which  training  digit  lit  up  the  respective  node  (only  90  training  digits  were 

used  for  these  tests) 

Table  4.5,  derived  from  the  tests  which  generated  these  figures,  shows  numerically  the  ad  van- 
*  tages  of  using  conscience.  Of  course,  these  tests  still  do  not  show  Kohonen  net  performance  on  a 

different  set  of  digits  than  those  used  in  training 


> 
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Figure  4.6.  Net  Path5  Trained  with  No  Conscience  Note  that  only  58%  of  the 
nodes  are  lit  up  when  the  training  digits  are  applied  at  the  inputs. 


tvopic.hdr  ->  speakl.net  ->  pftthi2.net 


Figure  4.8.  Net  Pathl2  Trained  with  Conscience  =  1.1.  When  a  large  amount 
of  conscience  is  used,  89  nodes  light  up  when  the  training  digits  are 
applied  This  does  not  necessarily  imply  a  commensurate  improvement 
in  word  recognition  performance. 


Table  4.C.  Scalar  Input  Net  Tests 


Method 

Accuracy 

Euclidean  search  of  training  set 

42% 

DTW  search  of  training  set 

■“90% 

DTW  search  of  non-training  set 

91% 

Note:  This  implies  that  "recognizing"  a 
node's  weight  vector  as  a  given  digit  is  in¬ 
effective  when  the  stretch  variable  is  not 
taken  into  account. 


Performance  of  75  Scalar  Input  Nets.  Initially,  it  was  assumed  that  identification 
of  a  node  with  the  training  digit  that  caused  it  to  light  up  was  the  proper  way  to  use  a  net.  That  is, 
input  an  unknown  (non  training)  digit,  see  which  node  lights  up,  and  identify  the  unknown  digit 
a>  the  training  digit  associated  with  that  node 

Euclidean  distance  is  the  algorithm  first  used  to  identify  a  lit  node  But  this  achieved  only 
a  4'29i  correct  identification  of  a  set  of  10 0  test  (non-training)  digits  Possibly  ,  this  resulted  from 
the  non-uniform  stretch  inherent  in  trajectories  Accordingly,  a  DTW  algorithm  was  substituted 
for  Euclidean  distance  (in  test  only,  not  training)  This  resulted  in  a  90%  correct  identification  of 
the  test  digits 

However,  it  is  possible  for  a  node's  weight  vector  to  be  "closer"  to  a  training  digit  (say  digit 
A)  which  did  not  cause  the  node  to  light  up  than  the  training  digit  that  did  (e  g  ,  digit  B)  This 
occurs  when  two  nodes  should  be  lit  up  by  digit  A,  but  the  software  allows  only  one  node  to  light 
up  (let  it  be  the  “first")  The  problem  occurs  when  the  activation  level  of  the  "second"  node,  from 
digit  B.  is  less  than  its  activation  level  from  digit  A.  Because  of  the  software,  the  second  node  is  lit 
by  B,  when  in  actuality  its  weight  vector  is  closest  to  the  input  vector  from  digit  A.  This  problem 
was  corrected  by  searching  through  a  set  of  100  non-training  digits  to  find  the  closest  one  to  each 
node.  This  increased  identification  to  91%.  Table  4.6  summarizes  the  above  findings  All  entries 
use  the  net  “pathl2"  trained  with  a  conscience  factor  of  1.1. 

With  this  data,  one  can  now  compare  DTW  with  a  second  Kohonen  net  as  word  recognition 
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Table  4.7.  Conscience  in  100  Scalar  Input  Nets 


Net 

Conscience 

Accuracy 

pathlfi(vl) 

1.1 

86% 

path 16 

1.5 

92% 

Note:  Too  much  conscience  (1.1) 
again  reduces  performance. 


algorithms.  With  the  DTW  routine  achieving  up  to  99%  accuracy,  the  91%  seen  here  is  not 


impressive. 


I 


Performance  of  100  Scalar  Input  Nets.  After  noting  that  a  substantial  number 
of  the  digits  had  reduced  trajectories  between  75  and  100  points,  the  routines  were  updated  for 
100  scalar  inputs.  Additional  tuning  also  took  place  in  the  DTW  routine  that  replaced  Euclidean 
distance.  The  minimum  path  distance  was  normalized  (divided  by  the  number  of  elements  in  the 
path)  to  give  a  local  average  path  length.  This  replaced  simply  dividing  by  the  number  of  node 
weights  not  (trailing)  zeros.  Another  change  was  to  use  the  length  of  both  the  trajectory  and  the 
number  of  node  weights  that  were  not  trailing  zeros.  Prior  to  this  point,  the  number  of  a  node’s 
weights  not  zero  was  used  as  the  DTW  length  for  both  the  node’s  weight  vector  and  the  word  under 
test. 


Table  4.7  shows  the  results  of  the  longer  inputs  and  retuned  DTW  as  the  amount  of  conscience 
in  the  second  Kohonen  net  is  varied.  Unfortunately,  the  changes  resulted  in  an  accuracy  only  1% 
better  than  the  best  75  scalar  input  net.  However,  it  shows  again  that  too  much  conscience  degrades 


> 


performance.  These  tests  used  “speaklO”  as  the  first  Kohonen  net. 


Performance  of  100  X-Y  Pair  Input  Nets.  Since  the  scalar  input  nets  provided 
>  only  92%  accuracy,  and  using  mini-DTW  rather  than  a  Euclidean  distance  increased  the  compu¬ 

tation  time,  another  approach  was  tried.  If  the  trajectories  remained  a  sequence  of  x-y  coordinate 
pairs  (instead  of  being  translated  to  a  sequence  of  scalar  values),  mini-DTW  might  not  be  necessary. 
)  Also,  the  training  effectiveness  might  improve  if  the  15  unit  difference  in  the  scalar  representation 
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Table  4.8.  Accuracy  of  100  X-Y  Pair  Input  Nets 


Net 

Conscience 

DTW 

TAXI 

path2i 

1.1 

86% 

84% 

path22 

1.5 

86% 

85% 

path23 

none 

69% 

Note:  T 

tiese  results  can  not  be  com- 

pared  to  that  of  scalar  nets  since  the 
set  of  training  digits  was  changed. 

Also,  the  improvement  from  DTW 
over  TAXI  distance  is  very  slight  in 
these  tests. 

Table  4.9.  Differently  Trained  100  X-Y  Pair  Input  Nets 


1st  Net 

2nd  Net 

Conscience 

DTW 

TAXI 

speaklO 

path26 

1.5 

85% 

80% 

speak  1 

path27 

1.5 

91% 

90% 

Note:  When  the  training  set  is  the  same  for 
both  scalar  and  x-y  pair  nets,  the  performance  is 
comparable — 91%  to  92%  . 


of  vertically  adjacent  nodes  is  absent. 

Thus,  training  and  test  routines  were  written  to  use  100  x-y  coordinate  pair  inputs  and  both 
DTW  and  Euclidean  (actually  TAXI)  distance  algorithms.  Table  4.8  compares  the  performance  of 
nets  using  both  algorithms  as  conscience  is  varied.  During  these  tests,  the  training  and  test  sets  of 
digits  were  changed.  Both  sets  used  only  90  digits  and  one  word  of  silence.  Also,  all  of  the  second 
nets  were  trained  using  “speaklO’'  (conscience  at  1.5)  for  the  first  net. 

These  tests  suggest  that  using  mini-DTW  (in  x-y  pair  nets)  to  identify  a  word  provides  only 
marginal  improvement  over  using  TAXI  distance.  However,  the  results  here  do  not  justify  going 
from  scalar  to  x-y  pair  inputs. 


Remember  though,  the  training  and  test  sets  were  changed  slightly.  Thus,  to  prevent  questions 
about  the  validity  of  comparing  these  accuracies  to  those  from  the  scalar  nets,  two  other  nets  were 
trained.  These  used  the  same  sets  of  100  training  and  test  digits  as  “pathl6”  (the  best  scalar  input 


net).  Table  4.9  shows  the  results;  the  conscience  factors  listed  are  for  the  second  net. 
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Table  4.10.  Scalar  Input  Nets  Without  Training 


First  Net 

No.  Inputs 

Conscience 

DTW 

TAXI 

speakl 

75 

none 

96% 

88% 

speak  10 

100 

1.5 

wmm 

Note:  Training,  with  the  procedure  and  training  data 
set  used,  was  actually  detrimental  to  net  performance. 


An  interesting  point  here  is  that  “speakl”,  trained  without  conscience,  resulted  in  the  best 
performance.  Also,  it  should  be  pointed  out  that  the  91%  achieved  here  is  not  significantly  different 
than  the  92%  obtained  for  scalar  input  nets. 

One  should  note  that  in  the  test  of  “path26”,  8  of  the  15  errors  had  zeros  labeled  as  twos 
on  node  number  16.  Yet  no  twos  were  closest  to  that  node.  The  logic  is  somewhat  complex, 
but  this  suggests  the  possibility  of  improvement  to  93%.  Unfortunately,  it  also  emphasizes  the 
nonuniformity  of  trajectories  within  classes  (of  digits)  and  the  need  for  supervised  learning  in  the 
first  Kohonen  net. 

Second  Kohonen  Nets  Without  Training.  As  was  mentioned  earlier,  the  second 
Kohonen  net  is  essentially  a  codebook  of  trajectories  (as  is,  really,  any  Kohonen  net).  So,  what 
would  be  the  result  if  the  training  set  of  100  digits  was  simply  assigned  to  the  100  nodes  and  no 
training  performed?  At  the  very  least,  one  would  obtain  a  baseline  from  which  the  effectiveness  of 
training  could  be  assessed. 

This  approach  is  feasible  for  the  second  Kohonen  net  since  the  number  of  training  inputs  is 
the  same  as  the  net  size.  For  the  first  Kohonen,  there  were  too  many  inputs. 

Table  4.10  shows  the  results  of  assigning  the  zeros  to  the  first  row,  the  ones  to  the  second, 
etc.  The  results  shown  use  scalar  inputs  and  vary  the  training  used  in  the  first  neural  net.  Both 
the  training  (now  just  assignment)  and  the  test  sets  of  digits  contained  100  words  without  silence. 
The  conscience  listed  is  that  used  in  the  first  Kohonen  net. 

This  shows  that  the  training  employed  here  does  not  improve  recognition  accuracy  of  scalar 
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Table  4.11.  X-Y  Pair  Input  Nets  Without  Training 


1st  Net 

No.  Inputs 

Conscience 

DTW 

TAXI 

speak  1 

75 

none 

95% 

88% 

speak  1 

100 

none 

mm 

■EE« 

speak  10 

75 

1.5 

93% 

speak  10 

100 

1.5 

mmm 

Note:  Again,  there  is  no  significant  difference  between 
scalar  and  x-y  pair  nets.  Neither  is  there  any  differ¬ 
ence  when  the  trajectory  length  is  75  or  100  points. 


input  nets.  But  what  does  training  do  for  x-y  pair  input  nets?  Table  4.11  shows  the  results  of  tests 
where  the  inputs  a re  x-y  pair  reduced  trajectories.  The  data  show  the  significance  of  the  trajectory 
length  (75  or  100).  Again,  the  conscience  listed  is  for  the  first  Kohonen  net. 


Clearly,  the  trajectory  lengths  used  here  do  not  affect  the  results.  Also,  it  appears  that 


with  the  current  forms  of  training  and  training  data  sets,  training  does  not  result  in  optimum 


performance  for  either  scalar  or  x-y  pair  input  nets! 


Connected  Speech  Recognition.  A  limited  amount  of  development  and  testing  was 
performed  using  the  second  Kohonen  for  recognizing  continuous  speech.  The  initial  results  were 
unsatisfactory  and  computationally  intensive.  Accordingly,  effort  was  discontinued  and  the  primary 
emphasis  was  placed  on  isolated  digit  recognition. 

However,  the  results  do  imply  some  promise  if  the  productivity  of  the  first  and  second  nets 
is  improved.  The  basic  routine  takes  a  100  slice  (partial  trajectory)  window  from  a  continuous 
utterance  and  compares  it,  using  the  DTW  algorithm,  with  all  the  nodes’  weight  vectors  in  a 
second  Kohonen  net.  As  described  earlier,  a  digit  is  selected  for  that  window.  The  window  is  also 
assigned  a  distance  which  is  the  normalized  minimum  path  length — the  smaller  the  better.  The 
window  is  moved  one  slice  at  a  time  from  the  start  of  the  utterance  to  the  end.  This  results  in 
a  sequence  of  digits  and  path  lengths  where  the  sequence  length  is  the  number  of  slices  in  the 
utterance.  When  the  path  length  becomes  a  minimum,  the  beginning  of  a  new  digit  (the  one 
assigned  to  that  slice)  occurs. 
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The  second  Kohonen  used  for  the  test  was  an  untrained  one  developed  from  the  trajectories 
through  the  first  net,  “speakl”.  This  had  the  highest  isolated  digit  recognition  rate  at  that  time. 
Two  utterances  containing  a  total  of  16  digits  were  tested.  One  utterance  was  slurred  together;  the 


other  was  spoken  distinctly.  The  recognition  rate  was  81.25%. 

Several  simple,  common  sense  rules  were  used  to  eliminate  brief  local  minima.  Additionally, 
the  computation  time  can  be  significantly  reduced  by  anticipating  the  minimum  number  of  slices 
between  words  and  using  a  gradient  search  algorithm  rather  than  computing  the  comparison  for 
every  slice.  Because  of  the  unsatisfactory  recognition  rate,  the  gradient  search  routine  was  not 
implemented. 

Summary 

This  chapter  has  quantified  the  performance  of  the  speech  recognition  system  developed  as 
well  as  the  factors  involved  in  its  performance.  Tradeoffs  show  the  system  works  best  with  sequential 
training  of  the  first  net,  a  conscience  factor  of  1.5,  and  DTW  as  the  word  recognition  algorithm. 
DTW  in  turn  works  best  (for  the  utterances  tested)  with  stretch  factors  of  1.0,  0.75,  and  0.75. 

When  a  second  Kohonen  net  is  substituted  for  DTW,  performance  falls.  It  doesn’t  seem  to 
matter  whether  scalar  or  x-y  pair  trajectories  are  used,  or  the  length  of  the  trajectories.  Unfor¬ 
tunately,  training  the  second  net,  rather  than  simply  assigning  arbitrary  trajectories  to  the  nodes’ 
weight  vectors,  seems  to  further  degrade  the  system. 

These  results,  and  their  implications,  are  summarized  in  the  next  chapter. 
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V.  Conclusions  and  Recommendations 

A  large  number  of  programs  were  developed  and  tested  to  demonstrate  the  feasibility  of 
using  neural  nets  and  dynamic  time  warping  in  speech  recognition.  Some  concepts  proved  to 
be  completely  unworkable  and  are  not  mentioned  here.  Others  showed  some  promise,  but  were 
neglected  for  development  of  more  promising  approaches. 

The  most  successful  algorithms  were  the  generation  of  net  trajectories  and  one  pass  dynamic 
time  warping.  But  because  of  the  intense  computations  required  by  DTW,  much  effort  was  spent  in 
developing  a  second  Kohonen  net  to  replace  it.  Unfortunately,  the  second  Kohonen  net  implemented 
here  does  not  perform  quite  as  well  as  DTW. 

Conclusions 

The  preprocessing,  first  net  training,  and  trajectory  reduction  algorithms  apparently  are 
adequate  to  assure  good  isolated  and  connected  digit  recognition  rates  in  speaker  dependent  speech. 
Using  conscience,  rates  of  99.1%  and  90.7%,  respectively,  can  be  achieved  from  a  one  pass  dynamic 
time  warping  algorithm.  A  second  neural  net  can  achieve  up  to  a  96%'  isolated  digit  recognition 
rate  (but  only  81%  for  connected  speech). 

Dynamic  Time  Warping.  The  computation  and  time  requirements  were  reduced  when  the 
DTW  input  vectors  (points  on  trajectories)  were  two  dimensional  rather  than  the  more  traditional 
16  to  256  dimensional  (possibilities  from  FFT  routines). 

However,  there  are  some  deficiencies  in  the  system.  First,  the  DTW  accuracy  appears  strongly 
dependent  on  the  choice  of  templates.  Secondly,  trajectories  within  a  digit’s  class  are  not  uniform 
enough  to  provide  excellent  results.  This  appears  to  be  a  problem  inherent  in  Kohonen  nets  trained 
without  supervision.  They  simply  do  not  group  all  of  the  members  of  a  class  in  the  same  region. 

The  latter  problem  appears  to  have  two  causes.  The  most  obvious  is  the  situation  where  a  class 
(a  particular  sound)  consists  of  members  in  two  disjoint  regions  in  15  dimensional  hyperspace.  The 
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other  cause  is  the  way  that  initial  weights  are  assigned  and  then  updated.  A  small,  but  significant 
percentage  of  nodes,  without  supervision,  can  simply  not  be  correctly  trained.  Correction  of  either 
of  these  problems  should  improve  consistency  and  performance. 

However,  any  DTVV  algorithm  will  always  be  computationally  intensive.  As  such,  it  is  ex¬ 
tremely  limited  when  a  larger  vocabulary  is  needed. 

Second  Kohonen  Net.  Using  a  second  Kohonen  net  in  place  of  DTW  appears  to  have 
possibilities.  Such  a  system  can  achieve  at  least  a  92%  isolated  speech  recognition  rate  (using 
trained  nets)  or  over  969k  when  the  net  acts  as  a  codebook  (no  training). 

The  fact  that  untrained  nets  produced  better  results  implies  that  either  training  produces 
weights  not  representative  of  the  data  set  to  be  recognized  (i.e.  the  training  equations  are  somehow 
defective)  or  that  the  training  procedure  is  in  error.  The  latter  is  the  most  likely  conclusion;  most 
probably,  there  was  simply  not  enough  data  to  effectively  train  this  size  net. 

Irrespective  of  the  reason  for  getting  better  results  with  untrained  nets,  the  accuracy  of  the 
trained  nets  is  satisfactory  to  evaluate  their  performance.  Thus,  the  following  thoughts  address, 
for  the  most  part,  trained  nets. 

The  accuracy  of  the  net  does  not  depend  significantly  on  the  form  or  length  of  the  word 
trajectories.  Routines  were  developed  where  the  trajectories  were  represented  both  as  sequences 
of  scalar  values  and  as  sequences  of  x-y  coordinate  pairs  (the  two  possible  forms).  Although 
the  scalar  representation  was  expected  to  have  more  difficulties  (because  of  the  15  unit  distance 
between  vertically  adjacent  nodes),  the  achieved  accuracy  was  actually  1%  better10  than  the  x-y 
pair  representation.  The  scalar  versions  achieved  92%  accuracy  as  compared  with  91%  for  the  x-y 
pair. 

However,  there  are  drawbacks  to  using  a  second  Kohonen  net  with  trajectory  inputs  even  if 
the  accuracy  is  improved.  The  non-uniform  stretch  in  words  requires  using  a  mini-DTW  algorithm 

10 1%  can  not  be  considered  a  significant  difference. 


rather  than  a  Euclidean  distance  (to  compare  and  identify  nodes  and  utterances)  to  achieve  the  best 
performance.  Using  a  mini-DTW,  such  a  net  could  not  be  efficiently  implemented  in  hardware. 
When  Euclidean  (actually  TAXI)  distance  is  used,  the  recognition  rate  drops  by  on-  to  several 
percentage  points.  Further,  a  dot  product  is  the  preferred  algorithm  over  Euclidean  or  TAXI 
distance,  but  dot  products  require  normalized  arguments.  The  scalar  and  x-y  pair  trajectories  used 
as  inputs  here  can  not  be  normalized  without  destroying  their  information  content.  Alternate  forms 
of  inputs,  that  could  be  normalized,  were  not  pursued  long  enough  to  determine  their  feasibility. 

Recommendations 

There  are  several  quite  obvious  tests  that  should  be  run.  These  include  speaker  independent 
tests,  larger  vocabularies,  and  alternate  (or  multiple)  feature  sets.  However,  there  are  a  few  basic 
changes  to  look  at  first.  The  mc>6t  important  of  these  is  to  obtain  consistent  in  class  trajectories.11 
Supervised  learning  of  the  first  Kohonen  could  limit  the  locations  of  sounds,  within  a  sound  class, 
to  a  particular  region.  Kohonen’s  learning  vector  quantization  (LVQ)  algorithm  (19)  could  perform 
this  task. 

After  supervised  learning  optimizes  the  trajectories,  the  preprocessing  procedure  might  be 
retuned  to  eliminate  any  unnecessary  processing.  This  could  be  done  by  repeatedly  making  a 
change  and  observing  the  results  on  the  automatic  DTW  tests. 

To  pe.mit  larger  vocabularies,  and  possibly  speaker  independence,  the  use  of  multiple  feature 
sets  might  be  investigated.  Dawson  (13)  and  Kim  (20)  were  successful  at  using  a  combination  of 
linear  predictive  coefficient  (LPC)  spectra,  zero  crossing  rate,  and  frication  frequency  to  identify 
speaker  independent  speech.  This  might  require  two  additional  very  small  nets  (possibly  only  one¬ 
dimensional),  with  a  small  increase  in  processing  time,  to  provide  a  large  jump  in  performance. 

If  necessary,  using  multiple  nets  or  templates  might  allow  recognition  of  speaker  independent 

11  “In  class”  here  refers  to  the  set  of  trajectories  for  any  given  word.  The  current  net  produces  out  of  class 
trajectories  that  are  separable,  but  does  not  produce  in  class  trajectories  that  “look"  alike. 


n 


5-3 


speech.  Tests  should  be  run  on  multiple  sets  of  utterances  from  various  speakers  and  a  larger 
vocabulary.  Kim  (20)  collected  such  a  set  of  data. 

Finally,  in  place  of  the  second  Kohonen  nets  developed  here,  one  might  try  other  algorithms. 
A  backward  propagation  net  might  work  very  well.  Alternatively,  one  might  delve  further  into  the 
use  of  activation  surfaces  as  inputs  to  a  second  Kohonen  net  rather  than  simple  trajectories.  If  a 
second  net  becomes  effective,  it  should  be  examined  for  use  in  identifying  connected  speech. 

Summary 

The  purpose  of  this  effort  was  to  show  the  feasibility  of  using  neural  nets  in  speech  recognition. 
For  speaker  independent  utterances  from  a  small  vocabulary,  that  was  done. 

Isolated  digit  recognition  was  achieved  at  up  to  99.1%  and  connected  speech  recognition 
at  93%.  While  this  used  only  a  small  vocabulary,  it  also  used  relatively  simple  feature  sets  and 
templates  chosen  without  significant  tuning 

By  adding  such  characteristics  as  supervised  learning  and  multiple  feature  sets  or  nets,  the 
prospect  is  bright  that  this  approach  could  successfully  handle  larger  vocabularies  and  speaker 
independence  while  keeping  additional  computation  time  to  a  minimum. 


Appendix  A.  Template  Trajectories 
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The  following  figures  show  the  reduced 


trajectories  for  the  eleven  templates  used  in  the  DTW 


tests.  The  templates  include  the  digits  zero  through  nine  and  a  short  period  of  silence. 


» 


> 


Reduced  Trajectory:  zeroO.trn  -->  epeaKlO.net 


Figure  A.l.  Reduced  Trajectory  of  the  Template  Zero 


Reduced  Trajectory:  oneO . trn  -->  apeaklO.net 


Figure  A. 2.  Reduced  Trajectory  of  the  Template  One 


Reduced  Trajectory:  tvoO.trn  -->  speaK10.net 


Figure  A. 3.  Reduced  Trajectory  of  the  Template  Two 


Figure  A.l  Reduced  Trajectory  of  the  Template  Three 


Reduced  Trajectory;  four5.trn  -->  epeaK10.net 


Figure  A. 5.  Reduced  Trajectory  of  the  Template  Four 


Reduced  Trajectory:  fiveO  trn  -->  epeaklO.net 


Figure  A. 6.  Reduced  Trajectory  of  the  Template  Five 


Reduced  Trajectory:  sixB.trn  -->  speakiO.net 


Figure  A. 7.  Reduced  Trajectory  of  the  Template  Six 


Reduced  Trajectory :  sevenO.trn  -->  9peaKi0.net 


Figure  A. 8.  Reduced  Trajectory  of  the  Template  Seven 


Reduced  Trajectory:  nineO.trn  -->  speakiO.net 


Figure  A. 10.  Reduced  Trajectory  of  the  Template  Nine 


Reduced  Trajectory:  eilenceS.trn  -->  apeak 10  net 


A. 11.  Reduced  Trajectory  of  the  Template  Silence 
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Appendix  B:  Computer  Programs 


There  are  a  few  points  about  this  appendix  that  make  it  easier  fc  .he  reader.  Headers  on  each  page  show  the 
appendix  title  on  the  left  and  the  appropriate  program  title  on  the  right.  At  the  top  of  the  first  page  of  each  program,  the 
link  command  for  that  program  is  listed.  In  the  link  command  are  those  *.c  files  used  to  create  the  program.  Each 
program  is  shown  below  (in  the  sequence  of  its  use  in  the  body  of  this  thesis)  along  with  its  page  number  and  the  files 
used  to  create  it.  Source  files  are  only  listed  once,  with  the  first  program  to  use  them. 

Unfortunately,  many  of  the  programs  and  files  use  subroutines  with  the  same  names  and  either  no  or  small 
differences.  Because  of  the  difficulty  of  identifying  the  differences,  such  subroutines  are  listed  repeatedly.  The  exception 
to  this  is  the  trajectory  reduction  process  (usually  found  in  the  subroutine  read_word),  which  is  only  listed  once.  Its 
complete  and  final  form  is  found  in  the  file  autodtw.c.  Thereafter,  it  is  abbreviated  as  ’...Trajectory  Reduction...’. 

Li«t  of  PrngriMi  and  Files 


autofft:  autofft.c . B-2 

neural7:  neural7.c,  neural4.c . B-8 

neural2:  neural2.c,  nplot.c,  nprinter.c,  mat2.c,  nweight4.c . B-16 

neural4:  neural4.c,  nplot.c,  nprinter.c,  mat2.c,  nweight4.c . B-39 

autodtw:  autodtw.c . B-46 

twokoh4:  twokoh4.c,  nweight8.c . B-55 

twobas2:  twobas2.c,  nweightlO.c . B-63 

outdat:  outdat.c,  ntraj.c . B-72 

twopic4:  twopic4.c,  nplot.c,  nprinter.c,  mat3b.c,  nweight8.c . B-78 

twomask:  twomask.c . B-85 

twopic6:  twopic6.c,  nwin5.c,  lookup6.c . B-87 

outdat3:  outdat3.c,  ntraj3.c . B-94 

twobas3:  twobas3.c,  nweight  1  l.c . B-98 

twopic4b:  twopic4b.c,  nplot.c,  nprinter.c,  mat3.c,  nweightl2.c . B-107 

twopic8:  twopic8.c,  n win6.c . B- 1 18 

outdat4:  outdat4.c . B-125 

twobas4:  twobas4.c,  nweight44.c . B-129 

twomask5:  twomask5.c . B-137 

twopic4c:  twopic4c.c,  nplot.c,  nprinter.c,  mat3.c,  nwt4.c . B-139 

twopic8b:  twopic8b.c,  nwin6b.c . B- 145 

twopic6b:  twopic6b.c,  nwin5b.c,  lookup6.c . B-152 

twopic8c:  twopic8c.c,  nwin6b.c . B-188 

twopic6c:  twopic6c.c,  nwin5b.c,  lookup7.c . B-161 

codebk:  codebk.c . B- 166 

codebkb:  codebkb.c . B-172 

codebk2:  codebk2.c. . B-178 

codebk2b:  codebk2b.c . B- 1 83 

coder:  coder.c . B-188 

coderb:  coderb.c . B- 194 
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$  link  autoflt, options  fila/opt 

r 

HmtMtMHtnmHHMMMU  autOfft.C  *«*«**••***»••*»*•*•*•***•**••»»•• 

INPUT:  sound.hdr  fils 
*.snd  files 

OUTPUT:  Mm  files 

This  routine  takes  the  *.snd  files  named  in  sound.hdr  and  transforms 
them  into  *.trn  files  white  leaving  the  original  ‘.and  files 
unchanged.  Vsnd  files  must  contain  a  leading  eight  bytes  of 
header  (thrown  away)  and  an  unspecified  number  of  bytes  of  sampled 
sound  data.  The  current  assumption  is  that  the  sound  is  sampled 
logarithmically  at  16  kHz  with  each  sample  being  one  byte. 

The  transformation  operates  on  256  samples,  moving  forward  in 
turn  85,  85  and  86  samples  so  that  an  overlap  ratio  of  3:1  is 
obtained.  Each  tranformation  cycle  takes  the  respective  256 
samples,  multiplies  by  a  Hamming  window  function  and  then  does 
a  256  point  FFT  The  resulting  128  frequency  magnitudes  are 
reduced  to  15  by  a  pseudo-logarithmic  reduction  in  which  the 
compression  ratio  is  greatest  at  the  higher  frequencies.  (The 
Kohonen  reduction  scheme  is  also  allowed  by  the  code,  but  it 
does  not  produce  acceptable  results  since  no  filter  is  included.) 

The  resulting  15  components  are  averaged  and  the  average  in  turn 
is  subtracted  from  each  component.  The  resulting  IS  components 
are  then  energy  normalized  to  one. 

Each  15  component  vector  (corresponding  to  the  initial  256 
samples)  is  then  written  to  a  Mm  file. 

*1 

#  include  stdio 

#  include  math 

#  define  PI3. 1415926536 

float  ham[2S6]  ; 

main  0 

( 

FILE  *fin,  *fhdr,  *fout ; 

float  xr[256]  ; 

irrt  i,  j,  n,  counter,  c,  limit,  temp  ; 

int  eofjlag  ; 

int  pointer,  overlap,  noise_flag  ; 

char  name_in(30],  name_out(30),  temp_name[30]  ; 

int  sum,  thjimit,  i_snd,  num_files  ; 

int  reductionflag ; 

printt  ("AUTOFFT:  Time/Frequency  Conversion  for  Kohonen  Net  ...\n\n") 

print!  ("Enter  (0)  logarithmic,  or  (1)  Kohonen  reduction.  ")  , 
scanf  ("%d",  &reduction_flag)  , 

n  =  256 : 

setup_hamming  (n)  ; 

fhdr  =  fopen  ("sounds.hdr",  "r")  ; 
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autofft 


(scant  (fhdr,  “%d",  &num_filas) ; 
for  (i_snd  =  0  ;  i_snd  <  num_tiles  ;  i_snd+  r)  { 
facanf  (fhdr,  temp_name)  ; 
sprintf  (namejn,  “%s.snd",  tamp_name)  ; 
fin  =  fopan  (namejn,  "rb") ; 
sprintf  (namejsut,  "%s.trn'',  temp_nama)  ; 
tout  =  fopen  (name_out,  “w")  ; 
printf  (“  %a  opened  name  out)  ; 
fimit  =  3000  ; 
th  Jimit  =  0  ; 

counter  =  0 ; 
overlap  =  0 ; 

i  =  0  ; 

pointer  =  8 ; 
noisejlag  =  0  ; 
aum  =  0 ; 
eofflag  =  0  ; 

fseek  (fin,  pointer,  0)  ; 

while  (eofjlag  !=  1)  { 
c  =  getc  (fin)  ; 
if  (feof(fin)  !=  0) 

eoMlag  =  1  ; 


/****  DATA  is  in  the  range  [0,255]  from  the  way  the  A/D 
software  worked!  *»*«*«/ 

else  { 

if  (c  >  1 27) 

c -=  256  ; 
sum  +  =  abs  (c)  ; 
xr[i++]  =  (float)  c  ; 

} 

if  ((i  =  =  n)  &&  (eoMlag  =  =  0)){ 
hamming  (n,  xr)  ; 
ffter  (n,  xr)  ; 

if  (reductionjlag  =  =  0) 

reduce_log  (xr)  ; 

else 

reduce_koh  (xr)  ; 
subtract_ave  (xr)  ; 
if  (normalize  (15,  xr)  !=  0)  { 
if  ((sum  >  thjimit)  1 1 

(noisejlag  =  =  0))  { 
tor  (j  =  0  ;  j  <  15  ,  j++) 
fprintt  (tout. 

"%hn",  xr[j])  ; 
rf  ( ■*■  +  counter  =  =  limit) 
eof  flag  =  1  ; 

} 

else 

printf("\n  Deleted  %d  @  %d\n", 
sum,  counter)  ; 

> 

i  =  0  ; 

rf  (overlap  <  2)  { 

pointer  -t-  =  85  ; 
fseek  (fin,  pointer,  0)  ; 
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autofft 


overlap  t  +  ; 

} 

else  { 

pointer  +  =  86  ; 

(seek  (fin,  pointer,  0)  ; 
overlap  =  0 ; 

> 

if  (sum  <  thjimit) 

noise_flag  =  1  ; 

else 

noise  Jlag  =  0 ; 
sum  =  0 ; 

} 

> 

fclose  (fin)  ; 

(close  (tout)  ; 

printf  (“  %d  vectorsAn",  counter)  ; 

> 

fcl os#  (fhdr)  ; 

} 


setuphamming  (n) 
int  n ; 


{ 

int 


i ; 


/****•  Set  up  the  lookup  table  (ham[i])  for  the  hamming  window 


> 


for  (i  =  0  ;  i  <  n  ;  I++) 

ham[i]  =  0.54  -  0.46  *  cos<2.0  *  PI  *  i  /  (n  - 1.0))  ; 


hamming  (n,  xr) 

int  n ; 

float  xr[256]  ; 

{ 

irrt  i  ; 


} 


for  (i  =  0  ;  i  <  n  ;  i++) 

xr[i]  *=  ham[i]  ; 


ffter  (n,  xr)  /*  FFT  */ 

int  n  ; 

float  xr(256J  ; 

< 

int  nv,  nm,  i,  j,  k,  m,  Le.  Ld,  p  ; 

float  xi(256],  ur,  ui,  rt.  it,  wr,  wi,  up  ; 

tor  (i  =  0  ;  i  <  n  ;  i+  +) 
xi(i]  =  0.0 ; 


nv  =  n/  2;nm  =  n-1;j  =  1; 
m  =  log((n  +  l)  *  1.0)  /  log(2.0)  ; 

for  (i  =  1  ;  i  c  =  n  ;  i+  +)  { 

xr[n  -  i  +  1)  =  xr[n  -  i]  ; 
xi(n  -  i  +  1]  =  xi[n  •  i)  ; 
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for  (i  =  1  ;  i  <  =  nm  ;  i+  +)  { 

if(i<D{ 

ft  =  xr[j]  ; 
it  =  xi(jj ; 

xr(j]  =  xr[i] ;  xi(fl  =  xi[i]  ; 
xr(i]  =  rt ; 
xifi]  =  it ; 

} 

k  =  nv ; 
while  (k  <  0  { 

j-=k; 
k/=  2; 

> 

i+=k; 

> 

for  (k  =  1  ;  k  <  =  m  ;  k++)  { 

Ld  =  pow  (2.0,  k  *  1.0)  ; 

Le  =  Ld  /  2  ; 
wr  =  cos  (PI  /  Le)  ; 
wi  =  -sin  (PI  /  Le)  ; 
ur  =  1.0; 
ui  =  0.0 ; 


for  (j  =  1  ;  j  <  =  Le  ;  j+  +)  { 

for  (i  =  j ;  i  <  =  n  ;  i  +  =  Ld)  { 
p  =  i  +  Le  ; 

rt  =  xrfp]  *  ur  -  xi[p)  *  ui ; 
it  =  xr[p]  *  ui  +  xi[p]  *  ur  ; 
xr[p]  =  xr[i]  -  ft ; 
xi(p]  =  xi[i]  -  it ; 
xr[i]  =  xr(i]  +  rt ; 
xi[i)  =  xi(i]  +  it ; 

> 

up  =  ur  *  wr  -  ui  *  wi ; 
ui  =  ui  *  wr  +  ur  *  wi ; 
ur  =  up  ; 

} 

} 

for  (i  =  1  ;  i  <  =  n  ;  i++)  { 
xr[i  -  1]  =  xr[i]  ; 
xi[i  -  1]  =  xi[i]  ; 

} 

for  (i  =  0  ;  i  <  n/2.0  ;  i  ++)/*  get  magnitude  */ 
xr(i]  =  sqrt  (xr[i]  *  xr(i]  +  xi(i]  *  xi[i])  ; 


normalize  (n,  xr ) 

int  n ; 
float  xr[256]  ; 

{ 

int  i , 
double  sum  =  0  ; 

for  (i  =  0  ;  i  <  n  ;  i++) 

sum  +  =  xr[i)  *  xr[i]  ; 
sum  =  sqrt  (sum)  ; 
if  (sum  =  =  0.0)  { 

printf  ("  An  input  vector  found  to  be  ZERO  thrown  away  ..  An”) 
return  (0)  ; 
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} 

for  (i  =  0 ;  i  <  n  ;  i++) 
xr]i]  /=  sum ; 
return  (1) ; 

} 


reduce  Jog  (xr} 
float 

{ 

int 


xr[256] ; 

I,  j,  counter ; 


xr[0]  =  xr[3] ; 
xrjlj  =  xr[4]  +  xr[5] ; 
counter  =  6 ; 
for(j  =  2;j<  13 ;/++){ 
xrtfl  =  0.0 ; 

for  (i  =  counter ;  i  <  counter  +  j ;  i+  +) 
xr[j]  +  =  xr(i] ; 
counter  +  =  j ; 

> 

xr[13]  =  0.0 ; 
for  (i  =  82  ;  i  <  102  ,  i++) 
xr[13]  +=  xr[i]  ; 
xr[14]  =  0.0  ; 

for  (i  =  102  ;  i  <  128  ;  i++) 
xr[14j  +  =  xr[i]  , 


reduce  koh  (xr) 
float 


{ 


int 


xr[256]  : 
i,  j,  counter ; 


for  (counter  =  0  ;  counter  <11;  counter+  +)  { 
xrfcounter]  =  0.0  ; 
for  (i  =  counter  *  6  +  1  ;  i  <  counter  *  6  +  7  ; 
xrfcounter]  +  =  xr(ij  ; 

> 

} 

for  (counter  =  0  ;  counter  <  5  ;  counter  +  +)  { 
xr[counter  +  11]  =  0.0  ; 
for  (i  =  67  +  counter  *  1 1  ;  i  <  78  +  counter 
xrfcounter  +  11]  +=  xr[i]  ; 

} 

} 

for  (i  =  122  ;  i  <  128  ;  i  +  +) 
xr[15]  +=  xr(i]  ; 


subtract  ave  (xr) 

'float  xr[256]  ; 

{ 

int  i ; 

double  sum  ; 


sum  =  0.0  ; 

for  (i  =  0  ;  i  <  15  ;  i+  +) 
sum  +  =  xr[i]  ; 
sum  /=  15.0  ; 
for  (i  =  0  ;  i  <  15  ;  i++) 
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xr[i]  •=  sum ; 


autofft 
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neura!7 


$  link  neuraI7,nweight4,  options  tile/opt 

/* 

>MHmmtMMMUMMMU«nU  neuraI7c  ••••••••*••••••••••*•*••• 

Routine®  to  generate  the  tint  layer  Kohonen  network  without 
graphics.  This  version  includes  CONSCIENCE  -  the  ability  to 
temporarily  remove  nodes  from  consideration  for  training  when 
they  have  already  received  more  than  their  share  of  training. 

Note  that  this  version  of  conscience  will  only  eliminate  a  node 
from  being  the  “closest"  to  the  input.  It  will  still  be  trained 
if  it  is  in  the  region  of  a  node  which  is  chosen  as  the  “closest". 


Implementation  of  Kohonen  neural  network  algorithm  as  illustrated  and 
described  in  IEEE  magazine,  Apr  87,  by  Dr.  Lippman. 

Capt  Gary  Barmore,  25  Aug  88 


GENERAL: 

(1)  Output  nodes  are  stored  in  a  m  x  n  matrix  with  each  node 
represented  by  weights  associated  with  each  ol  the  input 
nodes.  (Limited  to  20  by  20  array) 

(2)  Output  nodes  are  initialized  with  values  between  [-0.05,  +0.05]. 

(3)  For  each  iteration,  inputs  are  taken  from  a  Mm  file  which 
contains  a  sequence  of  15  component  vectors  generated  by 
AUTOFFT.EXE 

(4)  Gain  curves  may  be  either  linear,  sigmoidal  (not  very  successful) , 
or  piecewise  (two)  linear. 

(5)  The  size  of  the  neighborhood  is  reduced  as  a  function  of  the 
percentage  of  loop  completion.  In  piecewise  linear  gain  runs, 
the  second  “piece"  is  hardwired  to  have  neighborhoods  constant 
at  “1  1";  i.e.  the  closest  node  and  its  nearest  neighbors  (in 

a  rectangular  region). 


#  include  math 

#  include  stdio 

#  include  time 

irrt 

int 

double 

long 

long 

float 

double 

double 

double 

double 

int 

int 

int 

int 

long 

int 

int 

int 


conscience[20][20]  j*  records  #  times  closest  */ 

nodes  ;  /*  number  of  nodes  */ 

consc  =1.5;  /*  conscience  factor  */ 

its  ; 

nodes_elim ; 

map[20)(20][16]  ;  /*  output  nodes  */ 
input[16] ;  /*  input  nodes  */ 

gain  , 
mcount ; 
percent ; 

closest{2]  ;  /*  closest  node  */ 

neigh[2]  ;  /*  neighbor  */ 

nrangex,  nrangey  ;/*  neighbor  range  */ 

nfactorx,  nfactory  ;  /•  neighbor  factor  */ 

count ;  /•  #  of  iterations  */ 

graph  ;  /*  #  between  plots  */ 

seed  ; 

maxneighx,  maxneighy  J *  Starting  area  */ 


B-8 


% 


■ 


J! 


.1 


Appendix  B:  Computer  Program# 


int  minneighx,  minneighy  J"  Final  area  V 

int  xsize,  yeize ;  /*  Size  of  array  */ 

int  number  Jnputa ; 

char  training_file{30],  net_file[30] ; 

char  net_name[tS] ; 

struct  curve  { 
int 

double 
double 
double 
int 

}  gcurve ; 

struct  fig  { 
int 

}  flag  ; 

init  (map) 

float  map[20](20][16]  ; 

{ 

int  r,  c,  i ; 

float  max_rand  =  pow(2  0,  31 .0)  -1.0; 

nodes_elim  =  0 ; 

nodes  =  ysize  *  xsize  ; 

tor  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  xsize  ;  c+  +)  { 
conscience[r][c]  =  0  ; 
for  (i  =  0  ;  i  <  number Jnputs  ;  i+  +)  { 

map[r][c][i]  =  rand  0  /  max  rand  /  10.0  -  05  ; 

> 

> 


inp[16]  ; 
close[2]  ; 
map[20][20](16J ; 

r,  c,  i ; 

dot_product ; 
maximum  =  0.0 ; 


mindist  (map,  inp,  close) 
double 
int 
float 

{ 

int 

double 

double 


typ«; 

maxgain  ; 
mingain  ; 
midgain ; 
midtime ; 


rndjn  ; 


for  (r  =  0  ;  r  <  ysize  ;  r++)  { 

for  (c  =  0  ;  c  <  xsize  ;  c+  +)  { 

if  (conscience[r][c)  <  consc  *  its  /  nodes )  { 
dot_product  =  0.0  ; 
for  (i  =  0  ;  i  <  numberjnputs  ;  i+  +) 

dot_product  +=  inp[i]  •  map[r][c][i] 
if  (dot_product  >  maximum)  { 

maximum  =  dot_product ; 
close[0]  =  c  ; 
closefi]  =  r ; 

} 

> 

else 


nodes_elim  +  +  ; 
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> 

> 

conscience[close(1]][clo8e[0J]  +=  1 : 

> 

uaerinp  0 

{ 

int 
int 

struct  tm 
int 

do{ 

printf  ("NEUflAl.7  (Net  training  with  conscience  only!) ...  \n\n") ; 

printf(“Enter  size  ‘m  n'  (tor  an  m  x  n)  of  array  =  ?  (int  int]  ”) ; 
scanf("%d  %d",  &yaize,  &xsize)  ; 
if  (ysize  <  2) 

ysize  =  2 ; 
else  if  (ysize  >  20) 

ysize  =  20 ; 
if  (xsize  <  2) 

xsize  =  2 ; 
else  if  (xsize  >  20) 

xsize  =  20 ; 

printf( "Enter  name  of  training  tile  [trn  assumed]:  ")  ; 
scant  ("%8'',  net_name)  ; 
sprintf  (training_file.  "%s.tm",  net_name)  ; 
printff  Training  file  is:  %s\n ",  training  file) ; 

number  inputs  =  15  ; 
if  (number  inputs  <  2) 

numberjnputs  =  2 ; 
else  if  (numberjnputs  >  16) 

numberjnputs  =  16  ; 

printt("Enter  name  of  net  file  to  create  (.net  appended):  ")  ; 

scant  ("%s",  net_name)  ; 

sprintf  (netjile,  "%s.net",  netjiame)  ; 

printf("  Net  file  to  be  created:  %s\n",  net_file)  ; 

printf  (“Number  of  iterations  =  ?  (int]  ")  ; 
scant  C'%ld"',  &count)  ; 
if  (count  <  =  10  1 1  count  >  130000) 
count  =  100  ; 
mcount  =  (double)  count ; 

printf  (“Number  of  iterations  between  status  messages  =  ?  [int] '") 
scant  ("%d",  &graph)  ; 
if  (graph  <  1  1 1  graph  >  count) 
graph  =  10  ; 

ingain  0  ; 

printf  ("Do  you  want  0)  sequential  or  1)  random  izedtraining?  ")  ; 
scant  ("%d",  &ftag.rndjn) ; 

printf  ("Starting  size  of  neighborhoods  "yn  xn"  =  ?  [int  int] ")  ; 
scant  ("%d  %d",  &maxneighy,  &maxneighx)  ; 


line ; 
c ; 

•locaftimeO.  *time ; 
*bintim ; 


► 
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it  (maxneighx  <  2  1 1  maxneighx  >  xsize  - 1) 
maxnetghx  =  2 ; 

if  (maxneighy  <  2  1 1  maxneighy  >  ysize  - 1) 
maxneighy  =  2 ; 

print!  (“Fine!  size  of  neighborhoods  'yn  xn'  =  ?  [inrt  int]  "") ; 
scent  (“%d  %d",  &minneighy,  &minneighx)  ; 
if  (minneighx  <  1  1 1  minneighx  >  maxneighx) 
minneighx  =  1  ; 

if  (minneighy  <  1  1 1  minneighy  >  maxneighy) 
minneighy  =  1  ; 


t 


I 


> 


> 


} 

ingain  0 
{ 

int 


printf  (“Initial  seed  for  random  #  generator  (0  SELECTS  TIME)  =  ?  [int]  ”); 
scant  (“%d",  &seed)  ; 
if  (seed  =  =  0)  { 

time  =  localtime  (bintim)  ; 
time.tm_sec  %=  60 ; 
time.tm_min  %=  60 ; 
seed  =  time.tm  sec  *  time  tm  min  ; 

> 

srand  (seed) ; 

printf(  "Ready  to  begin?  (y/n)  ")  ; 

while  ((c  =  getc  (stdin))  =  =  "  1 1  c  =  =  "\n"  | )  c  *  =  M") 

>  while  (ci=y); 


line  ; 


printf  ("For  gain  enter  0)  UNEAR,  1)  SIGMOIDAL,  2)  PIECEWISE  UNEAR  : 
scant  (“%d",  &gcurve  type)  ; 

if  (gcurve.type  =  =  0  1 1  gcurve.type  =  =  1)  { 
printf  ("Maximum  gain  =  ?  [float)  ")  ; 
scanf  (“%E",  &gcurve.maxgain)  ; 
if  (gcurve.maxgain  >  =  1.0  1 1  gcurve.maxgain  <  =  0.0) 
gcurve.maxgain  =  .99  : 

printf  (“Minimum  gain  =  ?  [float]  ")  ; 
scanf  ( “%E",  Agcurve.mingain)  ; 
if  (gcurve.mingain  <=  0.0  1 1  gcurve.mingain  >=  1.0) 
gcurve.mingain  =  0.0 ; 


} 

else  { 

printf  (“First  segment  starting  gain  =  ?  [float]  ")  ; 
scanf  ("%£"’,  &gcurve.maxgain)  ; 
if  (gcurve.maxgain  >  =  1.0  1 1  gcurve.maxgain  <  =  0.0) 
gcurve.maxgain  =  99 ; 

printf  ("Second  segment  starting  gain  =  ?  [float]  '")  ; 
scanf  ("%E",  &gcutve.midgain)  ; 
if  (gcurve. midgain  <=  0.0  1 1  gcurve. midgain  >=  1.0) 
gcurve.midgain  =  0.0  ; 

printf  (“Second  segment  starting  iteration  =  ?  [float]  “)  ; 
scanf  (“%d  ",  &gcurve. midtime)  ; 
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if  (gcurve.midtime  <  =  0  ( |  gcurve.midtime  >  count) 
gcurve.midtime  =  count  /  2  ; 

gcurve.mingain  =  0.0 ; 

> 

> 

gst0ain  (0 

long  i ; 

{ 

if  (gcurve.type  =  =  0) 

gain  =  (percent  *  (gcurve.maxgain  -  gcurve.mingain))  +  gcurve.mingain  ; 
else  if  (gcurve.type  =  =  1) 

gain  =  0-9  *  (gcurve.maxgain  -  gcurve.mingain)  /  (1.0  +  exp  (i  •  count  /  2.0))  +  .1 

else  { 

if  (i  <  gcurve.midtime) 

gain  =  gcurve.maxgain  *  (1.0  -  (double)  i  /  gcurve.midtime) ; 

else 

gain  =  gcurve.midgain  *  (1.0  -  (double)  I  /  count) ; 

} 

> 

save_net  0 

{ 

int  r,  c,  i ; 

FILE  *fnet ; 


fnet  =  fopen(net_tile,"w")  ; 

fprintf  (fnet,  "%d  %d  %d",  y9ize,  xsize,  numberjnputs)  ; 
for  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 
for  (c  =  0  ;  c  <  xsize  ;  c+  +)  { 

for  (i  =  0  ;  i  <  numberjnputs  ;  i+  +)  { 

fprintf  (fnet,"  %(”,  map(r][c][i])  ; 

> 

> 

} 

fclose  (fnet)  ; 

} 


mainQ 

{ 


long 

char 

int 

int 

int 

FILE 

extern  unsigned 


si  [10]  ; 
k; 

wsjd  =  1  ; 
clear  flag  =  1; 
*tf ;  ~ 

_stklen  ; 


stklen  =  8192  ; 


userinp  0  ;  /*  Get  input  values  */ 

nfactorx  =  maxneighx  •  minneighx  +  1  ; 
nfactory  =  maxneighy  -  minneighy  +  1  ; 
init  (map)  ;  /*  Initialize  weights  V 

readjrnjile  0  ; 

for  (i  =  1  ;  i  <  =  count ;  i+  +)  { 
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} 

/* 


its  =  i  ; 

if  (i  %  graph  ==  0)  { 

printf  ("NEURAL3:  gain  =  %f,  yrange  =  %d,  ",  gain,  orangey)  ; 

printf  ("xrange  =  %d,  iteration  #  %d",  nrangex.i) ; 

printf  (“  (of  %ld)\n“,  count) ; 

k  =  nodes_eiim  /  (double)  graph  ; 

printf  ("%d  ave  nodes  eiiminaied!\n",  k)  ; 

nodes  slim  =  0  ; 

> 

percent  =  (mcourrt  -  i)  /  mcount ; 
getgain  (i) ; 
if  (flag,  mdjn  =  =  0) 
getin  0 ; 

else 

get_md_in  0  ; 

mindist  (map,  input,  closest) ; 
if  (gcurve.type  !=  2)  { 

nrangex  =  minneighx  +  peresnt  *  nfactorx  ; 
orangey  =  minneighy  +  percent  *  nfactory  ; 

> 

else  if  (i  <  gcurve.  midtime)  { 

nrangex  =  minneighx  +  nfactorx  * 

((double)  (gcurve. midtime  -  i))  /  gcurve. midtime  ; 
orangey  =  minneighy  +  nfactory  * 

((double)  (gcurve. midtime  ■  Q)  /  gcurve. midtime  ; 

> 

else  { 

nrangex  =  minneighx  ; 
nrangey  *  minneighy  ; 

> 

neigh[0]  =  nrangex  ; 
neighjl]  =  nrangex  ; 
weightem  (map)  ; 

} 

savenet  0  ; 

printf  ("\nNet  file:  %a  saved!\n",  netjile)  ; 


nweight4.c 


These  routines  allow  training  and  testing  of  a  first  layer  Kohonen 
network.  The  training  primarilly  supports  NEURAL7.C/EXE.  Testing 
(with  true  sound  spectrum  data)  supports  NEURAL2.C/EXE  to  recreate 
sounds. 


#  include  math 

#  include  stdio 

#  include  stat 


extern  double 

input[16]  ; 

/*  input  nodes  */ 

extern  double 

gain  ; 

extern  int 

closest  [2]  ; 

r  closest  node  *1 

extern  int 

neigh{2]  ; 

/*  neighbor  */ 

extern  int 

xsize,  ysize  ; 

/*  Size  of  array  */ 

extern  int 

number_ioputs  ; 

extern  char 

training_file[30]  ; 

.  ■ 


- « 


-  J 


fl 
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int 

float 

int 

int 

int 

int 

int 

read  tm  file  0 

{ 

FILE 

float 

unsigned 


tr  length  ; 
tr~data[22500] ; 
tr_counter  =  0 ; 
tr_vectors ; 
node_sound[225]  ; 
num_worda ; 
wordJimits[25][2]  ; 


*tf ; 

value  =  1.0; 
memory ; 


tf  =  fopen  (trainingjile,  "r") ; 
tr  Jength  =  0  ; 
while  (feof(tf)  =  =  0)  { 

fscanf  (tf,  “%f\  ivalue)  ; 
*(tr_data  +  tr  Jength)  =  value  ; 
tr  length +  +  ; 

f 

fclose  (tQ  ; 
tr  Jength- ; 

tr_vectors  =  floor  (tr Jength  /  15.0)  ; 
tr_length  =  15  *  tr_vectors  ; 


getin  0 

{ 

int  i  ; 


if  (tr_counter  =  =  tr  Jength) 
tr_courrter  =  0  ; 
for  (i  =  0  ;  i  <  15  ;  i++)  { 

input[i]  =  *(tr_data  +  tr_counter)  ; 
tr_courrter++  ; 


get  rnd  in  0 

{ 

int  i  ; 

double  max_rand  =  pow  (2.0,  31.0)  •  1.0  ; 

int  pointer ; 

pointer  =  15  *  floor  ((randO  *  (tr_ vectors  -  .0001)  /  max_rand))  ; 
for  (i  =  0  ;  i  <  15  ;  i++) 

input[i]  =  *(tr  data  +  pointer  +  i)  ; 

> 


weightem  (map) 

float  map[20]{20][16]  ; 

{ 

int  nright,  nleft,  nup,  ndown,  r ,  c,  i ; 


if  (neigh(0)  >  0  &&  neigh{1]  >  0)  { 

nright  =  closest(O)  +  neigh(O)  - 1  ; 
if  (nright  >  =  xsize) 

nright  =  xsize  - 1  ; 


« 
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nl eft  =  closest[0)  -  neigh [0]  +  1  ; 
if  (nleft  <  0) 

nleft  =  0; 

nup  =  cloeeet[1]  -  neigh[1]  +  1  ; 
if  (nup  <  0) 

nup  =  0 ; 

ndown  =  cloeest[1}  +  neigh[1]  - 1  ; 
if  (ndown  >  =  y  size) 

ndown  =  ysize  - 1  ; 


> 

else  { 

nright  =  closest[0]  ; 
nleft  =  closest[0]  ; 
nup  =  closest [1]  ; 
ndown  =  closest[1] ; 

> 

for  (r  =  nup;  r  <  =  ndown  ;  r+  +)  { 

for  (c  =  nleft ;  c  <  =  nright ;  c  +  +)  { 

for  (i  =  0  ;  i  <  number Jnputs  ;  i  +  +  ) 

map[r][c](i]  +=  gain  *  (input[i)  -  map[r][c][i])  ; 

} 

> 


« 


t 
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$  link  neuraE, nptot,nprinter,mat2,nweight4, options  file/opt 

/* 

•MMMMHMMMaMMtMmnm  neuraE.C  ••**■••*«**•**•*•■•****»■*' 

Routines  to  train  first  Kohonen  neural  net  (with  graphics)  and 
to  display  spectra  of  net  after  it  is  trained.  During  training, 
the  graphics  show  spectra.  However,  this  slows  down  the  training 
greatly.  Thus  if  time  is  important,  run  NEURAL7.EXE. 


Implementation  of  Kohonen  neural  network  algorithm  as  illustrated  and 
described  in  IEEE  magazine,  Apr  87,  by  Dr.  Lippman. 

Capt  Gary  Barmore,  7  Feb  88 


GENERAL: 

#  (1)  Output  nodes  are  stored  in  a  m  x  n  matrix  with  each  node 

represented  by  weights  associated  with  each  of  the  input 
nodes.  (Limited  to  20  by  20  arrays). 

(2)  Output  nodes  are  initialized  with  values  between  [-0.05,  -t-0.05]. 

(3)  For  each  iteration,  input  nodes  receive  values  consisting  of 
15  component  vectors  taken  from  a  *  tm  file  generated  by 
AUTOFFT.EXE. 

£  (4)  Gain  curves  may  be  linear,  sigmoidal  (not  very  successful)  or 

piecewise  (two  pieces  only)  linear. 

(5)  The  size  of  the  neighborhood  is  reduced  as  a  function  of  the 
percentage  of  loop  completion.  For  piecewise  linear  gain  runs, 
the  second  "piece"  is  hardwired  for  a  neighborhood  of  "1  1";  i.e. 
it  includes  the  closest  node  and  its  nearest  neighbors  in  a 
rectangular  grid. 

• 

#  include  math 

#  include  stdio 

#  include  curses 

#  include  time 

#  include  <gksdefs.h> 


• 

#  define  bool 

int 

float 

map[20][20](16]  ;  /*  output  nodes  */ 

double 

input[16]  ;  /*  input  nodes  */ 

double 

gain,  noise  ; 

double 

mcount ; 

double 

percent  ; 

int 

closest[2]  ;  /*  closest  node  */ 

int 

neigh[2]  ;  /*  neighbor  */ 

int 

nrangex,  nrangey  ;  /*  neighbor  range  */ 

int 

nfactorx,  nfactory  ;  /*  neighbor  factor  */ 

long 

count ;  /*  #  of  iterations  */ 

int 

graph  ;  /*  #  between  plots  •/ 

€ 

int 

seed  : 

int 

maxneighx,  maxneighy  ;  /*  Starting  area  */ 

int 

minneighx,  minneighy  ;  /*  Final  area  */ 

int 

xsize,  ysize  ;  1*  Size  of  array  */ 

int 

numberjnputs  ; 

char 

net_file(30],  net_name[  15]  ; 

< 

char 

training_fi!e(30]  ; 
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struct  curve  { 


I 


int 

typ«; 

double 

maxgain  ; 

double 

mingain  ; 

double 

midgain ; 

int 

midtime ; 

)  gcurve ; 

struct  fig  { 

int  mdjn ; 


>  ftafl : 


intt  (map) 

float  map[20][20][16]  ; 

{ 

int  r,  c,  i ; 

float  max_rand  =  pow(2.0,  31.0)  - 1.0  , 


for  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  xsiza  ,  c  +  +)  { 

for  (i  =  0  ,  i  <  numberjnputs  ;  i+  +)  { 

map[r][c][i]  =  rand  0  /  max  rand  / 10.0  -  .05; 

> 


mindist  (map,  inp.  close) 
double 

I  int 

float 


{ 


int 

double 

double 


inp[16]  ; 
ctose{2] ; 
map[20][20][16] ; 

r,  c,  i ; 

dot_product ; 
maximum  =  0.0 ; 


)  for  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  xsi2e  ;  c+  +•)  { 
dot_product  =  0.0 ; 
for  (i  =  0  ;  i  <  numberjnputs  ;  i  +  ■*■) 

dot  product  +=  inp[i]  *  map[r][c)[i]  ; 
if  (dot_product  >  maximum)  { 

maximum  =  dot _product ; 

I  clo9e(0J  ==  c  ; 

close[lj  =  r ; 

} 


userinp  0 

{ 

int 

int 

struct  tm 
int 


line ; 
c  ; 

*locattimeQ,  *time ; 
*bintim ; 


do  { 


initacr  0 ; 
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clear  0  I 

printw  (“NEURAL2  (Training  a  Sound  Net  with  GRAPHICS  only!) ...  \n\n") 

printw(“\n\nEnt*r  size  'm  n'(torimnxn)ol  array  =  ?  (int  int]  ") ; 
ecanw(“%d  %d",  Ayaize,  Axsize)  ; 

If  (ysize  <  2) 

ysiz*  =  2 ; 
alee  if  (ysiz*  >  20) 

ysiz*  =  20 ; 

H  (xaize  <  2) 

xsiz*  =  2 ; 
else  it  (xsize  >  20) 

xsiz*  =  20 ; 

printer  ("Enter  name  of  training  file  [leea  .tmj:  ")  ; 
scanw  (“%*",  net_name)  ; 
sprintf  (trainingjile,  “%e.tm",  net_name)  ; 
printer  (“  Training  file  is  :  %e\n",  training_file) ; 

numberjnputs  =  15 ; 
if  (numberjnputs  <  2) 

numberjnputs  =  2 ; 
else  if  (numberjnputs  >  16) 

numberjnputs  =  16  ; 

pririter("Enter  name  of  net  file  to  create  [less  .net):  ")  ; 

scanw  ("%*",  net  name)  ; 

sprintf  (net_file1  “%s.net",  net_name)  , 

printer  (“  Net  file  to  be  created:  %s\n",  netjile)  ; 

printer  ("Number  of  iterations  =  ?  [int]  ")  ; 
scanw  (“%ld".  Acount)  ; 
if  (count  <  =  10  1 1  count  >  130000) 
count  =  100 , 
mcount  =  (double)  count ; 

printer  (“Number  of  iterations  between  plots  =  ?  [int]  ”)  ; 
scanw  ("%d",  Agraph)  ; 
if  (graph  <  1  1 1  graph  >  count) 
graph  =  10 , 


ingain  0  I 

printer  ("Do  you  want  (0)  sequential  or  (1)  random  training?  ") ; 
scanw  ("%d",  Aflag.rndjn) ; 

printer  ("Starting  size  of  neighborhoods  yn  xn'  =  ?  [int  int]  ")  ; 
scanw  ("%d  %d”,  Amaxneighy,  Amaxneighx)  ; 
if  (maxneighx  <  2  j  |  maxneighx  >  xsize  - 1) 
maxneighx  =  2 ; 

if  (maxneighy  <  2  1 1  maxneighy  >  ysize  - 1) 
maxneighy  =  2  ; 

printer  ("Final  size  of  neighborhoods  yn  xn'  =  ?  [int  int]  ")  ; 
scanw  ("%d  %d",  Aminneighy,  Aminneighx) : 
if  (minneighx  <  1  1 1  minneighx  >  maxneighx) 
minneighx  =  1  ; 

if  (minneighy  <  1  1 1  minneighy  >  maxneighy) 
minneighy  =  1  ; 
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("InitiaJ  aaad  for  random  #  ganarator  (0  SELECTS  TIME)  =  ?  [int]  "); 
acanw  (“%d",  Aaeed) ; 
if  (aaad  ==  0)  { 

time  =  locaftima  (bintim) ; 
tima.tm_**c  %=  60 ; 
tim*.tm_min  %=  60 ; 
seed  =  tima.tm  sac  *  tima.tm  min  ; 

} 

•rand  (aaad) ; 

printw(“R*ady  to  begin?  (y/n)  ") ; 

whila  ((c  =  gatch  Q)  =  =  ”  1 1  c  =  =  Vi'  1 1  c  =  =  V) 


endwin  0  ; 

}  whila  (c !  =  Y) ; 

> 

ingain  0 

{ 

int  lina ; 


printw("For  gain  enter  0)  UNEAR.  1)  SIGMCHOAL  2)  PIECEWISE  UNEAR  :  "); 
acanw  (“%d”,  &gcurve.typa) ; 


if  (gcurve.type  =  =  0  1 1  gcurve.type  =  =  1)  { 

printw  (‘‘Maximum  gain  =  ?  [float]  “)  ; 
acanw  (“%E“.  &gcurve.maxgain)  ; 
if  (gcurve.maxgain  >-  1.0  1 1  gcurve.maxgain  <=  0.0) 
gcurve.maxgain  =  .99  ; 

printw  (“Minimum  gain  =  ?  [float]  “)  ; 
acanw  (“%E“,  Agcurve.mingain) ; 
if  (gcurve.mingain  <=  0.0  1 1  gcurve  mingain  >=  TO) 
gcurve.mingain  =  0.0 ; 

} 

else  { 

printw  (“Firet  segment  starting  gain  =  ?  [float]  ”)  ; 
acanw  (“%E“,  ^gcurve.maxgain) , 
if  (gcurve.maxgain  >=  TO  1 1  gcurve.maxgain  <  =  0.0) 
gcurve.maxgain  =  99  ; 

printw  (“Second  segment  starting  gain  =  ?  [float]  “) ; 
acanw  (“%E“,  Sgcurve  midgain)  ; 
if  (gcurve.  midgain  <  =  0.0  1 1  gcurve. midgain  >=  TO) 
gcurve. midgain  =  0.0  ; 

printw  ("Second  segment  starting  iteration  =  ?  [float]  ")  ; 
scanw  ("%d",  &gcurve.midtime)  ; 
if  (gcurve.midtime  <  =  0  1 1  gcurve. midtime  >  count) 
gcurve. midtime  =  count  /  2  ; 

gcurve.mingain  =  0.0 ; 

> 


getgain(i) 

long  i  ; 

{ 


if  (gcurve.type  =  =  0) 
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gein  =  (percent  *  (gcurve.  maxgain  -  gcurve.  mingain))  + 
gcurve.mingein ; 
ate*  if  (gcurve.type  ==  1) 

gain  =  0.9  *  (gcurve.mexgain  -  gcurve.mingein)  /  (1.0  +  exp  (i  • 
count/  2.0))  +  .1  ; 

eiee  { 

H  (i  <  gcurve.  midtime) 

gain  =  gcurve.mexgain  *  (1.0  -  (double)  i  /  gcurve.  midtime) ; 

eiee 

gain  =  gcurve.  midgain  *  (1.0  -  (double)  i  /  count) ; 


main  0 

{ 

int  c ; 

printf  ("AnNEURAL2  (Sound  net  Training  with  GRAPHICS  only!)  ..An  ") ; 

printf  ("AnDo  you  want  to  train  a  net?  (y/n)  ")  ; 

while  ((c  =  getcharQ)  ==  "  1 1  c  =  =  An'  1 1  c  =  =  AT) 


if(c==V) 

train_n*t  0  ; 

printf  (‘AnDo  you  want  to  draw  spectra  of  a  net?  (y/n)  ") ; 
while  ((c  =  getcharQ)  =  =  ' '  1 1  c  =  =  An"  1 1  c  =  =  At") 


} 


if(c==  V) 

draw_net_spectra  Q  ; 


savenet  Q 

{ 


int 

r,  c,  i ; 

char 

name(30] 

FILE 

•fnet; 

fnet  =  fopen  (net_file,  “w")  ; 

fprintf  (fnet,  ”%d  %d  %d ",  ysize,  xsize.  number_inputa) ; 
for  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

lor  (c  =  0  .  c  <  xsize  ,  c+  +)  { 

for  (i  -  0  ;  I  <  number Jnputs  ;  i  +  +)  { 

fprintf  (fnet,"  %f".  map[r][c][i])  ; 

} 

> 

} 

fclose  (fnet)  ; 

> 

save  temp  netO 

{ 

int  r,  c,  i ; 

FILE  ‘fnet ; 

char  temp_net(30]  ; 

sprintf  (temp_n*t,  "%s.mid",  net_name)  ; 

fnet  =  fopen  (temp_net,  "w ")  ; 

fprintf  (tnet,"%d  %d  %d",  ysize,  xsize,  numberjnputs) ; 

for  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

lor  (c  =  0  ;  c  <  xsize  ;  c+  +)  { 


neurafi 
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for  (I  =  0 ;  i  <  numberjnputs  ;  i+  +)  { 
fprintf  (fnst,  "  %f”,  mep[r][c][i]) 
} 

> 


drew  net  spectre  0 
{ 

int 

cher 

double 

float 

int 

FILE 

int 

int 

int 


flag,  r,  c,  i,  j,  k  ; 

neme[30],  s[10] ; 
in[16]  ; 
element ; 
loc{2]  ; 

•fend,  *fnet ; 

soundQ  =  {8,43,3,21,47,9,28,1}  ; 
sounds  =  8 ; 
fft3_flag ; 


printf  ("\nEnter  name  of  net-file  to  teat:  ")  ; 
scarf  (“%e’\  name) ; 
fnet  =  (open  (name,  “r”) ; 

fscanf  (fnet,"%d  %d  %d".  &ysize,  &xsize,  &number  Jnputs)  ; 
tor  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  xsize  ;  c+  +)  { 

tor  (I  =  0  ;  i  <  numberjnputs  ;  i+  +)  { 

fscanf  (fnet,"  %f",  &mep[r](e](i))  ; 

> 

} 

> 

fcloee  (fnet)  ; 

printf  ("Was  this  generated  by  (0)  FFT2  or  (1)  FFT3  ?  ")  ; 
scant  ("%d",  &«t3_flag)  ; 

graph  test  (name)  ; 
if  (ffl3_flag  !=  1) 

draw  grid  (ysize,  xsize)  ; 
draw_spectra  (map,  ysize,  xsize)  ; 
scant  (“%8’\s)  ; 
clipolt  0  : 
graphoff  0  ; 


train  net  0 

{ 

long 

char 

int 

int 

FILE 


i ; 

s  1  £  10}  ; 
ws_id  =  1  ; 
clear  flag  =  1; 
*tf;  " 


extern  unsigned  _stklen ; 
stklen  -8192 

userinp  0  ;  I*  Get  input  values  */ 
rrfactorx  =  maxneighx  -  minneighx  +  1  ; 
nfactory  =  maxneighy  -  minneighy  +  1  ; 
inrt  (map)  ;  /•  Initialize  weights  V 
read_tm_file  0  ; 
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prep_graph  0 ; 

ter  (i  =  1  ;  i  <  =  count ;  i+  +)  { 
if  (I  %  graph  =  =  0)  { 

ftxcolors  (map) ; 
dear_viewport  0  ; 

statueem  (gain,  orangey,  nrangex,  i) ; 
draw  spectra  (map,  yeize,  xsize) ; 

} 

if  (i%  10000  ==  0) 

seve_temp_net  0 , 
percent  =  (mcount  -  0  /  mcount ; 
get  gain  (j) ; 
if  (flag.mdjn  =  =  0) 
getin  0  ; 

etae 

get_md_in  0  ; 

mindist  (map,  input,  closeet)  ; 
if  (gcurve.type  !=  2)  { 

nrangex  =  minneighx  +  percent  *  nfactorx  ; 
nrangey  =  minneighy  +  percent  *  nfactory  ; 

> 

else  if  (i  <  gcurve.  midtime)  { 

nrangex  =  minneighx  +  nfactorx  * 
((doubie)(gcurve.midtime  -  0)  /  gcurve. midtime  ; 
nrangey  =  minneighy  +  nfactory  * 

((double)  (gcurve. midtime  -  i))  /  gcurve.midtime  ; 

} 

else  { 

nrangex  =  minneighx ; 
nrangey  =  minneighy  ; 

> 

neighfO]  =  nrangex  ; 
neigh[lj  =  nrangex  ; 
weightem  (map)  ; 

} 

8ave_net  0  ; 

prirrtf  (“\nNet  file:  %s  seved!\n  ",  net_file)  ; 
scartf  C‘%8".a1) ; 
end_graph  0  I 
print  data  (map)  : 

distance  histogram  (map.  ysize,  xsize)  ; 


graph  test  (name) 


{ 


char 

name(30] ; 

char 

title[79J,  labelx[79]  ; 

float 

xloc(5]  =  (0,  639.0,  639.0,  0  0,  0  0}  ; 

float 

yioc[S]  =  (349.0,  349.0,  0.0,  0.0,  3490} 

int 

points  =  5 : 

int 

ws_id  =  1  ; 

irtt 

clear_ftag  =  1  ; 

short 

length  ; 

sprintf(title,  "NEURAL2:  Kohonen  %d  x  %d  Neural  Net  • 
ysize,  xsize,  name)  ; 
graphon  0  ; 

gks$clear_ws  (&ws_id,  &clear_ftag)  ; 
gksSpolyline  (ipoints,  xtoc,  yloc)  ; 
prepcolmat  (ysize,  xsize) ; 


%8" 


J 

4 

neuraC 

I 


m 


i 


4 


■ 


9 


* 


4 
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neuraC 


length  =  (short)  strlen  (title) ; 
outtitle  (title,  length) ; 
length  =  (short)  strlen  (labelx) ; 
clipon  0  ; 

} 


prep_graph  0 
{ 

char 

title [79],  labelx [79] ; 

float 

xloc(5]  =  {0,  639.0,  639.0,  0.0,  0.0}  ; 

float 

yloc[5]  =  {349.0,  349.0,  0.0,  0.0,  349.0} 

int 

points  =  5 ; 

in! 

ws  Jd  = 1 ; 

int 

clear Jlag  =  1  ; 

int 

box  =  3 ; 

short 

length  ; 

sprintf (title, "NELinAL2:  Kohonen  %d  x  %d  Neural  Net ",  ysize,  xsize)  ; 
sprintf(labetx, 

“[%4.2f,%4.2f]  Gain,  [%d,%d  :  %d,%d]  Neighbors,  %d  Iterations", 
gcurve.maxgain,  gcurve.mingain,  maxneighy,  minneighy,  maxneighx, 
minneighx,  count)  ; 
graphon  0  I 

gks$create_seg  (&box) ; 
gksSpolyline  (&points,  xloc,  yloc)  ; 
gks$close_seg  (&box) ; 
prepcolmat  (ysize,  xsize)  ; 
length  =  (short)  strlen  (labelx) ; 
outiabetx  (labelx,  length) ; 
length  =  (short)  strlen  (title) ; 
outtitle  (title,  length)  ; 
pickcolors  0  ; 
clipon  0  : 

> 

end  graph  0 

{ 

clipoff  0  ; 
graphoff  0  ; 

> 

fixcolors  (map) 
float 

{ 

int 
int 

double 
double 

extern  int 

for  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  xsize  ;  c+  +)  { 
temp[r][c]  =  0.0  ; 

for  (i  =  0  ;  i  <  numberjnputs  ;  i+  +) 

temp(r][e]  +=  pow(map[r][c][i],  2.0)  ; 
if  (temp[r)[c)  >  max) 

max  =  temp[r][c]  ; 

> 

> 


map[20]{20][16] ; 

r,  c,  i ; 

max  =  o  ; 
constant ; 
temp(20)[20]  ; 

coimat(20][20] ; 
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if  (max  1=0.0) 

constant  =  14.988  /  max  ; 

aiaa 

constant  =  14.988 ; 
for  (r  =  0  ;  r  <  ysiza  ;  r+  -*■)  { 

for  (c  =  0  ;  c  <  xsize  ;  c+  +)  { 

coim at[r](c]  =  floor  (temp[r)[cl  *  constant)  +  1  ; 
if  (colmat(r][c]  >15) 

coJmat[r][c]  =  15 ; 

> 

> 

} 

r 

MMtMMMMMttMMMMIMMi  npiOt.C 

Routines  to  enable  graphics  for  Micro-VAX  II  workstation  using  GKS 
for  Kohonen  network  speech  recognition. 

*/ 


#  include  math 

#  include  stdio 

#  include  <gksdefs.h> 

#  include  <deecrip.h> 

#  define  MAX  STRING  80 

double  xlow,  xup,  ylow,  yup  ; 

double  xdei.  ydel ; 

float  x[100],  y[100]  ; 

graphon  0 

{ 

int  ws_id  =  1  ; 

int  error_status,  category.  inquireokay  ; 

int  dummy Jnt,  def_mode,  regenjlag,  ws_type  ; 

int  rx.  ry.  units  ; 

float  x.  y  ; 

float  xO  =  0.0  ; 

float  xl  =  639.0  ; 

float  yO  =  0.0  ; 

float  yl  =  349.0  ; 

int  deferral  mode  =  GKS5K  ASAP  ; 

int  regen_mode  =  GKS$K_IRG_SUPPRESSE0  ; 

struct  dscSdescriptor  dummy _dsc  ; 

char  dummy _string  [MAX_STRING]  ; 

^DESCRIPTOR  (error_file,  “sysSerror:") ; 

inquire_okay  =  0 ; 

dummy _dsc.dsc$a_pointer  =  dummy _string  ; 
dummy _dsc.dsc$w_length  =  (short)  MAX_STRING  ; 

gks$open_gks  (&error_flle) ; 

gks$inq_ws  category  (&GKS5K  WSTYPE  DEFAULT,  &error  status.  &category); 

r 

#  Make  sure  workstation  type  is  valid. 

V 

if  ((error_8tatus  !  =  inquire_okay)  1 1 


neuraC 
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neuraC 


((category  !  =  QKSSK  WSCAT  OUTIN)  && 

(category  1=  QKS$K_WSCAT_MO)))  { 
printf  ("The  specified  workstation  type  ia  invalid\n")  ; 
prlntf  (“Error  statue:  %d\n",  error_statue)  ; 
return ; 

} 

gk«$open_wa  (4ws_id,  4GKS$K_CONID_DEFAULT,  4GKS$K_WSTYPE  DEFAULT); 

gkaSactivate  we  (&ws  id) ; 

r 

*  Make  aura  deferral  mode  and  regeneration  flag  are  properly  set. 

8ke$eet_defer_state  (4wsjd,  &deferraJ_mode,  4regen_mode) ; 

gks$inq_ws_type  (4ws_id,  4error_etatue,  Adummy_dec,  4we_type, 

Adummyjnt)  ; 

gks$inq_def.defer_state  (4we_type,  4error_status,  4def_mode, 

Aregen  _flag)  ; 

if  (error_statua  I  =  inquire_okay)  { 

printf  (“The  deferral  Inquiry  caused  an  erroAn ')  ; 
printf  (“Error  statue:  %d\n'\  error_statua) ; 
return  ; 

} 

I* 

*  Set  up  viewport  for  drawing  figuree. 

V 

gks$aet_window  (Awa  Id,  &x0,  4x1,  AyO,  4y1)  ; 

gka$aetect_xfomr)  (&ws_id)  ; 

> 

graphoff  0 

{ 

int  ws_id  =  1  ; 

gks$update_ws  (4w»_id,  AGKS$K_PERFORM_FLAG)  ; 

gks$deactivate_wa  (4ws_id)  ; 

gks$close_w8  (&wa_id)  ; 

gks$cloee_gk8  0  ; 


clipon  0 
{ 


int 

w&2 

=  2; 

float 

xO  = 

0.0; 

float 

xl  = 

560.0; 

float 

yo  = 

0.0; 

float 

yi  = 

269.0; 

float 

VX0  = 

=  0.183, 

float 

vxl  = 

=  0.881  ; 

float 

vyO  = 

=  0 1143  ; 

float 

vyl  = 

=  0.9400; 

int 

on  = 

1  ; 

gksSeetj window  (Awa2,  4x0,  4x1,  4y0,  4y1)  ; 
gks$set_viewport  (4ws2,  4vx0,  4vxl,  4vy0,  4vy1)  ; 
gka$eeiect_xform  (4we2)  ; 
gke$eet  clipping  (Aon) ; 

} 

clear  viewport  0 

{ 

float  xIocQ  =  (0,0,  560.0,  560.0,  0.0,  0.0}  ; 
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float  ytocQ  =  {268.0, 268.0, 0.0,  0.0,  288.0)  ; 

int  points  =  5 ; 

in*  solid  =  1  ; 

int  background  =  0  ; 

int  black  =  1 ; 

gksSaet  JWcolorJndax  (^background) ; 
gks$**t_flMJnt_«tyl*  (isolid)  ; 
gks$fill_ar*a  (Apoints,  xloc,  yloc) ; 
gksSeet  fill  color  index  (Ablack) ; 

> 

clipofl  0 

( 

int  off  =  0  ; 

int  ws_id  =  1  ; 

gksSselectxform  (Awsjd)  ; 
gksSset  clipping  (Aofl)  ; 

> 

outaxaa  0 

{ 

int  xx.  yy,  points  ; 
points  =  2  ; 

y[0]  =  y[1)  =  38  ;  x[0J  =  60  .  x[1]  =  620  ; 
gksSpoiylina  (&points,  x.  y)  J*  Plot  horizontal  axis  */ 

x[0]  =  x[1]  =  60  ;  y(0]  =  329  ;  y(1)  =  40  ; 
gksSpoiylina  (&points,  x,  y)  J*  Plot  vertical  axis  */ 

x[Q]  =  57  ;  x[1)  =  59  ; 

for  (yy  =  39  ;  yy  <  =  329  ;  yy  +  =  58)  {/•  Plot  y  ticks  */ 
yl°]  =  y(i)  =  yy  ; 
gksSpoiylina  (Apoints,  x,  y)  ; 

> 

y[0]  =  38  ;  y[1]  =  36  ; 

for  (xx  =  60  .  xx  <  =  620  ;  xx  +  =  56)  {/*  Plot  x  ticks  */ 
x(0]  =  x{1  J  =  xx  ; 
gksSpoiylina  (Apoints.  x.  y)  ; 

> 

> 

outlimits  (x2.d2,e2,x1,dl,sl)  /*  x-axis  than  y-axis  */ 
double  x1,d1,x2,  d2  , 

int  at,  a2 ; 

{ 

char  s[5],  sa[9) ; 

$OESCRIPTOR(s  dsc.s) ; 

SDESCRIPTOR(ss_dac,sa)  ; 

int  ticks(3],  loop,  xx,  yy.  flag  ; 

double  xypos[3],  delta(3] ; 

double  a  ; 

float  xloc,  yloc ; 

ticks[0]  =  5  ;  ticks[1]  =  10  ; 

a  =  afi ; 

xlow  =  x2  *  pow  (10.0,a)  ; 
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rveuraC 


xup  =  xtow  10.0  *  d2  *  pom  (10.0, a) ; 

a  =  •> 

ytow  -  xl  *  pow  (10.0, a) ; 

yup  =  ylow  +  5.0  *  dl  *  pow  (lO.O.e)  ; 

detta(0]  =  dl  ;  detta(1)  =  02  ; 
xypoa(0]  -  xl  ;  xypoe[1]  =  x2  ; 
for  (flag  =  0 ,  flag  <  =  1  ,  flag+  +)  { 

for  (loop  =  0  ;  loop  <  =  ticka[flag]  ;  loop+  +)  { 
xx  =  7  +  loop  *  7  ; 

aprintf  (e,"%4.1f',xypoe(flag]) ; 
xloc  =  1.0  +  8.0  *  (xx  -  2.0)  ; 
yloc  =  34.0  ; 

gkaStaxt  (&xloc,  &yloc,  &•  dec)  ; 

> 

else  { 

aprintf  (s,"%4.lf",xypoa[ftag])  ; 
xloc  =  22.0 ; 

yloc  =  349  0  -  16.0  -  (5.0  -  loop)  *  58.0  ; 
gkaStaxt  (&xloc,  &yloc,  &s  dec)  ; 

} 

xypoe(flag)  +  =  datta[flag]  ; 

} 

> 

if  (a2  I  =  0)  { 

aprintf  (aa.  ‘(x  E%3d]",a2)  ; 
xloc  =  312.0 ; 
yloc  =  22.0  ; 

gkaStaxt  (&xk>c.  &yloc,  &sa  dec)  ; 

> 

if  (el  !=  0)  { 

xloc  =  -10; 
yloc  =  0.0  ; 

gks$aet_text_upvec  (&xloc,  &yloc)  ;  /*  rotate  text  to  90  dag  */ 
aprintf  (aa,'‘[x  E%3d]",a1)  ; 
xloc  =  26  0  ; 
yloc  =  209  0  ; 

gkaStaxt  (&xk>c,  &yloc.  &aa_dac)  ; 
xloc  =  0.0  ; 
yloc  =  1.0; 

gkaSaet  text  upvec  (&xloc.  &yloc)  ;  /*  change  text  to  normal  */ 

} 

xdet  =  (xup  -  xlow)  /  560  0  ; 
ydal  =  (yup  -  ylow)  /  290  0  ; 


outfit  la  (string,  length) 

short 

length  ; 

char 

•string  ; 

{ 

int 

title  =  1  ; 

int 

loc  , 

float 

xloc,  yloc 

struct  dacSdaacriptor  atring_dac  =  {length, 

DSCSK  DTYPE  T, 
DSC$K_CLASS”S, 
string)  ; 

xloc  =  320.0  -  3  0  *  length  ; 


B-27 


Appendix  B:  Computer  Program* 


ytoc  =  343.0  ; 
gka$cr*at*_sag  (&title) ; 
gksStext  (&xloc,  &y(oc,  &string_dsc) ; 
gk<$cloM  aag  (Atrtle) ; 

} 

outlabetx  (string,  length) 

short  length ; 

char  'string ; 

{ 

int  labetx  =  2  ; 

int  loc  ; 

float  xloc,  yloc ; 

struct  dscSdescriptor  string  dsc  =  {length, 

DSC$K  DTYPE  T. 
DSC$K_CLASS~S, 
string}  ; 


xloc  =  320.0  -  3.0  *  length  ; 
yloc  =  100 ; 

gks$create_seg  (&labetx)  ; 
gksStext  (&xloc,  &yloc,  &string_dsc)  ; 
gks$close  seg  (&labetx)  ; 

} 

outlabeiy  (string) 


char 

string[80] 

int 

loc  ; 

float 

xloc,  yloc 

$OESCRIPTOR(string_dsc, string)  ; 

loc  =  strlen(string) ; 
string[loc]  =  ‘\0'  ; 
xloc  =  -1.0  ; 
yloc  =  0.0  ; 

gks$set_text_upvec  (&xloc,  &yloc)  ; 
xloc  =  13.0  f 

yloc  =  349  0  -  164  0  -  4  0  *  loc  ; 
gksStext  (&xloc,  &yloc,  &string_dac)  ; 
xloc  =  0.0  ; 
yloc  =  10; 

gks$set_text_upvec  (&xloc,  &yloc)  ; 


/* 

•*••••••••<••••••••••••••••••••••••«  nprjn(#r  c  •«*••»•••••»*•*•«•• ••••♦• •»*< 

Simulates  printer  output  by  storing  Kohonen  training  data  in  a  file 
PRINTER.OUT.  This  file  was  written  when  NEURAL*  EXE  was  still 
being  written  and  run  on  a  Tandy  4000.  The  current  version  of  the 
Kohonen  training  routines  may  not  have  the  appropriate  hooks  in  them 
to  run  these  printer  routine*. 

V 

#  include  stdio 

#  include  math 

FILE  *fp,  *fop enQ  , 


neural2 


% 
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neuraB 


double  net ; 

extern  int  xsize,  ysize,  number Jnputs,  wrap_flag  , 

extern  struct  curve  { 

int  type ; 

double  maxgain ; 

double  mingain ; 

double  midgain ; 

int  midtime ; 

}  gcurve ; 


popen  0 

{ 

fp  =  fopen  (“printer.out",  "w") ; 
tputc  (15,fp)  ; 

> 

pcioee  0 

{ 

fclose  (fp) ; 

> 

pfeed  0 

{ 

fputc  C\n',fp) ; 

> 

p  return  (lines) 

int  lines ; 

{ 

int  i ; 


> 


for  (i  =  1  ;  i  <  =  lines  ;  i++) 
fprintf  (fp,"\n”)  ; 


pnrrtdala  (map) 
float 


{ 


int 


map  [20]  [20]  [16]  ; 

r,  c,  i ; 


extern  int 
extern  int 
extern  double 


count,  maxneighx,  maxneighy,  minneighx,  minneighy  ; 
seed ; 
xoff,  yoff ; 


printf  (“\nDo  you  want  parameters  and  weights  printed  out?  (y/n)  ")  ; 
while  ((c  =  getcharQ)  =  =  "  1 1  c  =  =  \n'  1 1  c  =  =  ‘M’) 


if  (c  •=  VI 

return  (0)  ; 


popen  0  ; 
pfeed  0  ; 

fprintf (fp,"\nNEURAL..\n - \n\n")  ; 

f  printf  (fp,  "SIZE  OF  ARRAY  ;  %d  x  %d\n", ysize, xsize)  ; 
fprintf(fp,  "NUM8ER  OF  INPUTS  :  %d\n  ",number_inputs)  ; 
if  (gcurve  type  =  =  0)  { 

fprintf  (fp,  "GAIN  CURVE  IS  :  %s\n",  LINEAR")  ; 
fprintf  (fp,  "RANGE  OF  GAIN  :  (%g,%g]\n". 
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neuraB 


gcurve.maxgain.gcurve.mingain) ; 

> 

eta*  if  (gcurve.type  =  =  1)  { 

fprintf  (fp.'GAIN  CURVE  IS  :  %a\n", 

"SIGMOIDAL")  ; 

fprintf  (fp.'RANGE  OF  GAIN  .  t%g,%g]\n" 

gcurve.maxgain.gcurve.mingain) ; 

> 

else  { 

tprintf(tp,"GAIN  CURVE  IS  :  %a\n", 

"PIECEWISE  UNEAR")  ; 

fprirrtf(fp, "MAXIMUM  GAINS  (AND  BREAKPOINT)  :  %g.%g  (%d)\n", 
gcurve.maxgain,  gcurve.midgain,  gcurve. midtime) ; 

> 

fprintf(fp, "NEIGHBORHOODS  START  AT  :  %d  %d\n”. 
maxneighy,  maxneighx); 

fprintf(fp.  "NEIGHBORHOODS  END  AT  :  %d  %d\n", 
minneighy,  minneighx); 
fprintf(fp,"SEED :  %d\n",seed) ; 

fprintf(fp, "INITIAL  X-OFFSET,  Y-OFFSET  :  %g  %g\n",xoff,yoff)  ; 
if  (wrap  Hag  =  =  0) 

“  fprintf  (fp,"WRAP  :  OFF\n")  ; 

etee 

fprintf  (fp,"WRAP  :  ON\n")  ; 
p_r# turn  (3)  ; 

fprintf  (fp, "Final  values  for  weights  are:\n\n")  ; 

for  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

for  (i  =  0  ;  i  <  numberjnputs  ;  it  +)  { 
for  (c  =  0  ;  C  <  xsize  ;  c+  +) 

fprintf  (fp,"%5  If  ",  map[r][c][i])  ; 
p_retum  (1)  ; 

r 

p  return  (1)  ; 

f 

pclose  0  ; 

> 

dietance_histogram  (map.  ysize.  xsize) 


int 

ysize,  xsize  ; 

float 

m*p[20][20)[16]  ; 

int 

binQ  =  {0,  0,  0,  0,  0,  0,  0,  0,  0,  0)  ; 

irrt 

bin2D=  {0,0,0, 0,0,  0,0, 0,0,0,  0,0, 0,0,0,  0, 0,0,0, 0) 

float 

maximum  =  0.0  ; 

float 

minimum  =  9999  0  ; 

int 

binmax  =  0  ; 

int 

binmax2=  0  ; 

float 

dist[20][20}[4],  a,  b,  delta  ; 

int 

r,  c,  i,  j ; 

double 

tot,  sub  ; 

print!  ("\nDo  you  want  distance  histogram  printed  out?  (y/n)  ")  ; 
while  ((c  =  getcharO)  =  =  "  1 1  c  =  =  An’  1 1  c  =  *  M") 

if(c!=y) 

return  (0)  ; 
popen  0  ; 


1 
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pi^dO  ; 

fprintf  (fp.'The  distance  histogram  ia:\n\n")  ; 

for  (r  =  0  ;  r  <  ysiz*  ,  r+  +)  { 

for  (e  =  0  ;  c  <  xaiz* ;  C++)  { 

»(r==0) 

dM(r][c){0]  =  -1.0 ; 

aiaa  { 

dM(r](c][0]  =  0.0 ; 
for  0  3  0  ;  I  <  number  inputs  ;  i+  +) 
di*t{rl[cl[0]  +  = 

pow{mapIr]{c)[i]  -map[r- 1  ][c)  [i]  .2.0) ; 
dist[r][c)[0]  =  sqrt  ((double)  dist[r)[c)[0]) ; 
test  maxmin  (dtst(rj(c][0],  Amaximum,  Aminimum); 
} 

if  (r  =  =  ysiz*  - 1) 

dist(rj[c][2)  3  -1.0 ; 

else  { 

dist[r][c][2]  =  0.0 ; 
for  (i  =  0  ;  i  <  number  inputs  ;  i+  +) 
distlr][cj(2]  +  = 

pow(map[r]  [c][i]  -map[r  + 1  ]  [c]  [i]  ,2.0) ; 
dist[r][c][2]  =  sqrt  ((double)  d«t[r][c][2]) ; 
test  maxmin  (diat[rj[c]{2],  Amaximum,  Aminimum); 
) 

if  (c  =  =  0) 

dist[r]{c][1]  =  -10; 

else  { 

dist[r][c](1]  =  0.0 ; 
for  (i  =  0  ;  i  <  number  inputs  ,  i+  +) 
d.st(rl{cl(1]  +  = 

pow(map[rl(cl(i]-map[r][c-l][il,2.0); 
dist[r][c](l]  =  sqrt  ((double)  dist(r][c][1]) ; 
test  maxmin  (dist(r]|cl(1!,  Amaximum.  Aminimum); 
> 

if  (c  3  =  xsize  •  1) 

dist[r][c][3]  *  -1.0 ; 

else  { 

diat(r|[c](3]  =  0  0 ; 
for  (i  =  0  ;  i  <  numb*r_inputs  ;  i+  +) 
dist[r][c][3]  +  = 

pow(map[r][c)[i)-map(r)[c+1][i].2.0); 
dist[r][c][3]  =  sqrt  ((double)  dist[r][c][3]) ; 
test  maxmin  (dist(r][c][3],  Amaximum,  Aminimum); 
> 

> 

} 

tot  =  0.0  ; 
sub  =  0.0  ; 

delta  =  5.0  *  sqrt  ((double)  number  inputs)  /  20.0  ; 
for  (j  =  0  ;  j  <  20  ; )+ +)  { 
a  =  j  •  delta  ; 
b  =  (j  +  1.0)  *  delta  ; 
for  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  xsize  ;  c+  +)  { 

for  (i  =  0  ;  i  <  4  ;  i+  +)  { 

if  ((dist[r][c](i]  <  =  b)  AA 
(dist(r](c](i]  >=  a))  { 
bin2(j]  +  +  , 
tot  +=  1.0 ; 
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if  (b<n2(j]  >  binmax2) 

binmax2  =  bin2[Q  ; 

> 

for  (j  =  0 ;  i  <  3 ;  j+  +) 

sub  +  =  bin2[j] ; 
nsi  =  sub  /  tot ; 

for  (j  »  0  ;j  <  20 ;  j++)  { 
a  =  j  •  delta  ; 
b  =  (j  +  1.0)  *  doits  ; 

fprintf  (fp,"[%6.2f  •>  %6.2f]  %4d  ”,  a,  b,  bin2lfl) ; 
for  (i  =  0  ;  i  <  40  *  bin2(j]  /  binm*x2  ;  i+  +) 
fputc  f'.fp)  ; 
p  return  (1) ; 

p_return  (2)  ; 

delta  =  (maximum  -  minimum)  /  10.0  ; 
for  (j  =  0  ; )  <  10  ;  j+  +)  { 

a  =  minimum  +  j  *  delta  ; 
b  =  minimum  +  (j  +  1.0)  *  delta  , 
for  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  xsize  ;  c+  +)  { 

for  (1  =  0  ;  i  <  4  ;  i+  +)  { 

if  ((dist[r][c)[i]  <=  b)  && 
(di*t[r][c][i]  >=  a)) 
bin(j]  +  +  ; 

> 

} 

> 

if  (bin(j)  >  binmax) 

binmax  =  binQ]  ; 

> 

for  (j  =  0  ;  j  <  10  ;  j++)  { 

a  =  minimum  +■  j  *  delta  , 
b  =  minimum  +  (j  +  1.0)  •  delta  ; 
fprintf  (fp,“[%6.2f  ->  %6.2f]  %4d  ",  a,  b,  bin(j))  , 
for  (i  =  0  ;  i  <  40  *  bin[j]  /  binmax  ;  i  +  +) 
fputc  ('*  .fp)  ; 
p  return  (1)  ; 

> 

pclose  0  ; 

> 

fom  (number,  loc,  in,  ysize,  xsize) 


int 

ysize,  xsize,  number ; 

int 

loc  [64]  [2]  ; 

double 

in[64][16]  ; 

double 

dl,  d2,  alpha,  sum,  var 

int 

i,  j.  k  ; 

double 

maxi,  max2,  nei,  fig  ; 

maxi  =  10.0  *  sqrt  ((double)  numberjnputs)  ; 

max2  =  sqrt(  pow(  (double)yaize,  2.0)  +  pow(  (double)xsize,  2.0) )  ; 

sum  =  0.0 ; 
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for  (i  =  0  ;  i  <  number  - 1  ;  i+  +)  { 

tor  (j  =  1+1 ;  1  <  number ;  j++)  { 
dl  =  0.0 ; 

for  {k  =  0 ;  k  <  number Jnpute  ;  k-r  +) 

dl  +  =  pow(in[i][k]  -  mQ][k]  ,  2.0)  ; 
dl  =  *qrt  (dl )  / mexl ; 

d2  =  oqrt  ( pow  ((double)  (tocflfO]  -  Ioc[j]f0)).  2 .0)  + 
pow((doubte)0oc[i][1]  -  k>c(j][l]),  2.0) )  /  mex2; 

•urn  +*  pow  (dl  -  d2 , 2.0)  ; 

> 

> 

ver  -  eqrt  (sum) ; 
fig  =  var*  ( 1.0  +  net) ; 

popenO ; 

p_recum  (2) ; 

fprintf  (fp,’\nThe  template  test  FOM  is  %7.4f ',  ver)  ; 
fprintf  (fp,  ViThe  neighborhood  FOM  is  %7.4f,  net) ; 
fprintf  (fp."\nThe  COMPOSITE  FOM  is  %7.4f',  fig)  ; 
pfeed  0  ; 
pcloee  0  I 


ti 


{ 


} 


rnexmin  (diet,  max.  min) 

float  dist ; 

float  "max ; 

float  *min ; 

if  (diet  <  *min) 

•min  =  diet , 
if  (diet  >  *max) 

•max  =  diet ; 


r 


mat2.c 


Routines  to  draw  net  diagrams  (spectra),  net  trajectories,  and 
graphics  for  net  training  routines.  All  graphics  are  performed 
using  GKS  routines. 


#  include  stdio 

#  include  math 

#  include  <gksdefs.h> 

#  include  <descrip.h> 


#  define  BLACK 

0 

#  define  WHITE 

1 

float 

ptsx[20][20][5],  ptsy[20](20](5] 

float 

px[20)(20),  py(20][20] ; 

int 

used  [20]  [20]  ; 

int 

colmat[20](20]  , 

int 

pattsm[16J  = 

(0,  -15,-15,  -12,-12,  -11,-11,  -1,-1,  -2,-2,  -4,-4,  -5,-5,  1}  ; 


prepcolmat  (ysize,  xsize) 
int  xsize ; 

int  ysize ; 

{ 
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int  r.  c,  xstart,  ystart ; 

int  dx,  dy ; 

dx  =  floor  (550.0  /  xaize) ; 
dy  =  floor  (276.0  /  yaiza)  : 

xstart  =  280  -  dx  *  xaiie  /  2 ; 
ystart  -  148  +  dy  *  yaiza /2 ; 

for  (c  =  0 ;  c  <  xaize ;  c+  +)  { 

for  (r  =  0 ;  r  <  yaize  ;  r+  +)  { 

ptax(r][c](4]  =  (ptax[r][c]{3]  =  (ptsx[r]{c][0]  = 
xaUrt  +  c  *  dx)) ; 

ptax[rl(c][2]  =  (ptax(r][cl(1]  =  ptsx[r][cH0]  +dx- 1)  ; 
ptay[r][c][4]  =  (pt*y[r][c][1]  =  (ptay[r](c)[0]  = 
yatart  -  r  *  dy)) ; 

ptsy[r][c}[3]  =  (ptey[r][c][2]  =  ptay[r][c][0)  -dy+  1)  ; 
px(r](cj  =  ptaxlr][c](0]  +  8.0  ; 
py(r][cl  =  ptay(rj(cl(0]  -  8.0  ; 

} 

} 

for  (r  =  0  ;  r  <  20  ;  r++)  { 

for  (c  =  0  ;  c  <  20  ;  c+  +)  { 
uaad[r][c]  =  0 ; 

} 


show  am  0 
{ 

int  i ; 

float  ractx[16](6],  racty[16H6]  ; 

int  points  =  5  ; 

for  (i  =  1  ;  i  <  16  ;  i++)  { 

rectx[i][4J  =  (ractx[i](3)  =  (ractx[i](0]  =  173  +  16  *  i))  ; 

rectx[i][2]  =  (ractx[il[1]  =  (rectx(i][01  +  15))  ; 

recty(i][4]  =  (recty[i][1]  =  (r«cty[i][0]  =  30))  ; 

recty[i][3]  =  (r«cty[i][21  =  23)  ; 

sotfillstyle  (patternfi).  i)  : 

gks$fill  area  (&points,  &rectx(il(01,  &recty[iH01)  ; 

> 


setfillstyle  (pattern,  pointer) 
int  pattern ; 

int  pointer ; 

‘  int  style  =  3 ;  /*  hatch  */ 

int  color(16]  =  (0,  7.7,  3,3,  5,5,  4,4,  4,  6,6,  2,2,  1}  ; 

if  (pattern  >  =  0)  { 

gksSset  fill  int  style  (&pattem)  ; 

} 

else  { 

gksSset  fill_style_index  (&pattern)  ; 
gka$set_fill  int  .style  (&styte) ; 

> 


B-34 


Appendix  8:  Computer  Program* 


’  draw.net  (number,  loc) 

int  number,  loc [64] [2] ; 

{ 

int  i,  old_value ; 

int  white  =  0 ; 

int  black  =  1  ; 

float  x,  y ; 

>  char  *[4] ; 

$OESCRIPTOR(a_dac,a) ; 

for  (i  =  0  ;  i  <  number  ;  i+  +)  { 

x  =  pt*x[loc[i][1]][loc[i][0]][0]  +  4.0  ; 
y  =  pt«y [loc[i]  [1  ]] [loc{i]  [0]] [0]  -  4.0  ; 
old  value  =  used[loc(ij[1]][loc[i][0]] ; 

I 

gks$*et_text_colorjndex  (Awhile)  : 
sprintf  (s,"%5d",-oid_value) ; 
gksStext  (Ax,  Ay,  Ae_ dec) ; 

sprintf  (s,  ”%3d",i+1)  ; 
gks$set_text_colorjndex  (Ablack)  ; 

)  gks$texT(Ax,  &y,  As_dsc) ; 

if  ((i+1  !=  old  value)  AA  (old  value  I  =  0))  { 
y  -=  6.0 ; 

sprintf  (*,"••*")  ; 
gksAtext  (Ax,  Ay,  As  dec)  ; 

> 

,  used[loc[i][1]][loc[i](0]]  *  i+1  , 

> 


draw_neighbors  (number,  loc) 

int  number,  loc[64][2]  ; 

{ 

int  j,  old_value ; 

int  white  =  0  ; 

int  black  =  1  ; 

float  x,  y  ; 

char  s[4]  ; 

$DESCRIPTOR(s_dsc,s)  ; 

for  (i  =  0  ;  i  <  1  ;  i++)  { 

>  x  =  ptsx[loc(i] (1  ]] [loc[i] [0]] [0]  +  4.0  ; 

y  =  ptsy [loc(i] [  1  ]] [loc[i] [0]] [0]  -  4.0  ; 
old_value  =  used[loc[i][1]][loc[i][0]] ; 

gk8$8et_text_color_index  (Awhile)  ; 
sprintf  (s,"%3d ',  old_value)  ; 
gksStext  (Ax,  Ay,  As  dsc)  ; 

) 

sprintf  (s,  ”%3d",  (number+1))  ; 
gks$s*t_text_colorJndex  (Ablack)  ; 
gksStext  (Ax,  Ay,  As_dec) , 

if  ((number+1  !=  old  value)  AA  (old  value  !=  0))  { 
y  -=  6  0 ; 

)  sprintf  (s,"***'l  ; 


neuraE 
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gksStext  (&x  &y,  &s  dec) ; 

> 

ueed[(oc[n[1]][loc[n(0]]  =  number+1  ; 

> 


dr*w_speech_map  (number,  loc) 

int  number,  loc  [125]  [2] ; 

int  i,  old_  value  ; 

int  white  =  0 ; 

int  black  =  1 ; 

float  x,  y,  xx[2],  yy[2] ; 

int  points  =  2 ; 

char  s[4] ; 

$DESCRIPTOfi(s_d*c,s)  ; 

for  (i  =  0  ;  i  <  number  ;!++){ 

x  =  pt«x[loc[i]  [1  ]]  [loc[i]  [0]](0]  +  4.0  ; 
y  =  ptsy  [loc[i]  [1  ]]  [loc(i]  [0]]  [0]  -  4.0  ; 
otd_value  =  ueedlloc[i][1]][loc[i][0]] ; 

gke$eet_text_coiorJndex  (iwhite)  ; 
eprintf  (e,"%3d",  oidvaloe)  ; 
gksStext  (&x,  &y,  &s_dec)  ; 

gks$set_taxt_coiorjndex  (iblack) ; 
sprintf  (s,"%3d'\  i+1)  ; 
gksStext  (&x,  &y,  &s_dsc) ; 

if  ((i+1  !=  old_ value)  &&  {old  value  !=  0))  { 
y  -=  6.0 ; 

sprintf  (e, "*•*") ; 
gksStext  (&x.  &y.  &s  dsc)  ; 

> 

used[loc[i](1]][loc[il[0]]  =  i+1  ; 
if  0  • =  0)  { 

xx{0]  =  px[loc[i-1][l]][loc[i-1](0]] ; 
xx[1]  =  px[loc[i][1]](loc[il[0]l ; 
yy(°]  =  py[loc[i-1][1]][loc[i-1][0]]  ; 
yy[1]  =  py[loc[i][1]][loc(i][0]]  ; 
gksSpolyline  (&points,  xx,  yy)  ; 

} 


draw_grid  (ysize.  xsize) 

int  xsize,  ysize ; 

{ 

int  points  =  5  ; 

int  r,  c  ; 

for  (r  =  0  ;  r  <:  ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  xsize  ;  c+  +)  { 

gksSpolyline  (&points,  &ptsx[r][c][0],  &ptsy[r][c][0]); 

} 

) 

i 
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dfew_*pectra  {map,  yeize,  xsize) 


int 

xsize,  ysize ; 

float 

map[20H20][16] ; 

int 

points  =  2 ; 

float 

*I2],y[2]; 

int 

r,  c,  i ; 

for  (r 

=  0  ;  r  <  ysize ;  r+  +) 

for  (c  =  0 ;  c  <  xaize  ;  c  +  +)  { 
y{0]  =  ptay(r][c][3]  ; 
for  (i  =  0  ;  i  <  15  ;  i++)  { 

x(0]  =  pUx[r][c][3]  +  2.0  +  (2.0  •  i) ; 
*11]  =  xJO)  ; 

y{1]  *  y[0]  +  16.0  *  map[r][c][i]  ; 
gksSpoiyline  (&pointa,  x,  y) ; 
x[0]  +=1.0; 
xjlj  +=1.0; 

gksSpolylina  (ipointa,  x,  y) ; 

> 


drawgr  12  (yaize,  xaize,  sub_title,  length) 


int 

xsize,  ysize ; 

char 

sub_title[30] 

short 

length ; 

int 

points  =  5 ; 

int 

r,  c ; 

float 

xloc,  yloc  ; 

struct  dac$deecriptor  title  dac  =  { length, 

DSCSK  0TYPE  T, 
DSC$K_CLASS~S, 
subjitle ) ; 


for  (r  =  0  ;  r  <  ysiza  ,  r+  +)  { 

for  (c  =  0  ;  c  <  xsize  ;  c+  +)  { 

gksSpoiyline  (ipoints,  &ptsx[r][c}{0],  &ptay[r] [c] [0]); 

} 

} 

xloc  =  277  Q  -  3.0  *  length  ; 
yloc  =  2.0 ; 

gks$text  (&xloc,  &yloc,  &title  dsc)  ; 

> 

statusem  (gain,  orangey,  nrangex,  its) 
double  gain ; 

int  orangey,  nrangex ; 

long  its ; 

{ 

float  xloc,  yloc  ; 

char  s(60) ; 

$OESCRIPTOR(s_dsc,s) ; 

sprintf  (s, 

"Gain  =  %4.2f  Neighbors  =  %2d,%2d  Iteration  #  %5ld", 
gain,  orangey,  nrangex,  its)  ; 
xloc  =  76.0  ; 
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yloc  =  2.0 ; 

gkaStaxt  (Sxtoc,  iytoc,  &s  dec) ; 

> 

cotorom  (ysiza,  xaiza) 

int  xaiza,  yaize ; 

{ 

int  r,  c,  color  ; 

int  points  =  5  ; 

for  (r  =  0  ;  r  <  ysiza  ;  r+  +)  { 

for  (c  =  0 ;  c  <  xaiza  ;  c+  +)  { 
color  =  coimat[r][c] ; 
setfillstyle  (pattam[color],  color)  ; 
gks$fill_area(&points,  &ptax[r][cltO],  &ptsy[r][c][0]): 


pickcoiors  0 

{ 

return  ; 

} 
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$  link  neuraM, nptat.nprinter.mdQ.mfeigiM.optiorwjUe/ofA 
/* 

MMHMMnmMMMMutmtMt  r>*U«M.C  ••*****••****»*********•*** 

Hiee*  routine*  will  optionally  recreate  *snd  files  for  replay,  graph 
traced  one*  through  net*,  and  create  a  record  of  the  full  t  rectory 
reduction  proceea  in  a  \trj  file. 


Capt  Gary  Barm  ore,  7  Feb  86 


V 


#  include  math 

#  include  stdio 

#  include  curse* 

#  include  time 

#  include  <gfcadefe.h> 


#  define  boot  irrt 


float  map[20][20][16] ;  /*  output  nodes  */ 

doubt*  input[16] ;  /*  input  nodea  V 

irrt  xsize,  ysize  ;  /*  Size  of  array  V 
irrt  number  jnputs ; 

char  training_filel30]  ; 


mindiat  (map,  inp,  cloae) 
doubt* 
int 
float 

{ 

int 

double 

double 


inp[16]  ; 
close(23  ; 
map[20][20][16]  ; 

r,  c,  i ; 

dot_product ; 
maximum  =  0.0  ; 


for  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  xsize  ;  c+  +)  { 
dot_product  =  0.0 ; 
for  (i  =  0  ;  i  <  number  Jnputs  ;  i  +  +) 

dot_product  +=  inp[i]  *  map[r)[c][i]  ; 
if  (dot_product  >  maximum)  { 

maximum  =  dot_product ; 
close(0]  =  c  ; 
ciese(lj  =  r ; 

> 


main  0 

( 

irrt  c ; 

print!  ("\nNEURAL4  (Sound  TRAJECTORIES!)  An") ; 
map  speech  0  ; 

} 
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map  speech  0 
{ 

int 

flag,  r,  c,  i,  ],  k  ; 

char 

name [30],  name2[30],  subjitle[60],  s[10],  temp[30] 

char 

name  trj{20] ; 

double 

in[16]7d1,  d2,  d3.d4.d5; 

float 

element ; 

int 

toc[l2S][2],  loc2[12S][2],  loc3[12S][2]  ; 

FILE 

*fsnd,  *fnet,  Mo ; 

int 

sound,  point,  replica,  x[5],  y[5]  , 

short 

length ; 

int 

max_pts ; 

char 

an»wer[  10]  ; 

int 

srvd  fiag,  fft  ftag,  graph_ftag  ; 

printf  (“Do  you  want  (0)  sound  file  created  or  ( 1 )  not?  ")  ; 
scant  ("%d".  &snd_flag) ; 
it  (snd_flag  ==  0){~ 

printf  ("Enter  name  of  training  file  used  [lees  tm]:  ”) ; 

scant  ("%a",  temp)  : 

sprintf  (training_flle,  “%e.tm",  tamp) ; 

printf  ("Created  with  (0)  FFT  or  (1)  FFT2:  ")  ; 
scant  (“%d",  &fft_flag) ; 

printf  (“\nReading  training  file  into  memory  l\n")  ; 
read  tmfile  0  ; 

} 

printf  (“Do  you  want  (0)  NO  graphics  or  (1)  TRAJECTORIES:  ")  : 
scant  ("%d",  &graph_flag)  ; 

printf  ("\nEnter  name  of  net-file  to  use  [less  net]:  ") : 

scant  (“%s".  temp)  ; 

sprintf  (name,  "%s.net",  temp)  ; 

fnet  =  (open  (name,  “r")  ; 

fscanf  (fnet,"%d  %d  %d",  &ysize,  &xsi ize,  Anumber  Jnputs)  ; 
for  (r  =  0  ;  r  <  ysize  ,  r+  +)  { 

for  (c  =  0  ;  c  <  xsize  ;  c+  +)  { 

for  (i  =  0  ;  i  <  number Jnputs  ,  i+  +)  { 

fscanf  (fnet,"  %f",  &map[r][c][ i]) ; 

} 

> 

> 

fclose  (fnet)  ; 

if  (snd_flag  =  =  0) 

correlate_sounds  (map)  ; 


tor  („)  { 

printf  ("\nEnter  name  [next]  of  speech  file  to  map  [less  tm],  '7  ; 

scant  ("%s",  temp) : 

sprintf  (name2,  "%s.trn",  temp) ; 

fsnd  =  fopen  (name2,  "r") : 

sprintf  (subjitle,  “%a  •■>  %s",  name2,  name)  ; 

sprintf  (namejrj,  "%s,trj",  temp)  ; 

to  =  fopen  (namejrj,  “w") ; 

if  (graph  flag  =  =  1)  { 

graph  Jest  (name)  ; 
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tength  =  (short)  *trten  (subjitte) ; 
draw  grids  (ysizo,  xsizs,  sub  titla,  langth) ; 

> 

sound  =  0 ; 
i  =0; 

flag  =  0  ; 

white  (Hag  !=  1)  { 

(scant  (find,  "%f 4af*mant)  ; 

#  (facfflsnd)  1=0)  { 
flag  =  1  ; 

> 

sisa  { 

in[i]  =  (doubts)  stsmorrt ; 
i++  ; 

> 

«((i=  =  15)44(«ag==0)){ 

mindist  (map.  in,  4loc  [sound]  [0]) ; 
i  =  0  ; 
sound  +  +  ; 

> 

> 

fclos*  (tend)  ; 
if  (graphjag  ==  1)  { 

1  draw_spaach_map  (sound,  loc)  ; 

scant  ("%*", *7 ; 
ciipoff  o ; 
graphoff  0  . 

} 

fprintf  (to,  “%s\n ",  sub_titls)  , 

fprintf  (to,  AnTrajactory  through  map:  (%d)\n\n'\  sound) 
for  (i  =  0  :  i  <  sound  :  i+  +)  { 

point  =  loc[i][0]  +■  loc[i][l]  *  xsizs  ; 
if  ((i%  15)  ==  0) 

fpnntf  (fo,  "\nV3d  ",  point)  ; 

•Is* 

fprintf  (fo,  ‘  %3d  ",  point)  , 

} 

!  for  (i  =  0  :  i  <  sound  ;  i+  +)  { 

Ioc3[i][0]  =  loc[i][0]  ; 
loc3[i][1]  =  loc[i][1]  ; 

} 

max  pts  =  sound  ; 

1*0; 
if  0  ■ =  0) 

maxjats  =  j , 

}  )  =  0  ; 

for  (k  =  0  ,  k  <  3  ;  k+  +)  { 
x[k]  =  Ioc3[k](0]  ; 
y[k]  =  loc3[k][1]  ; 

} 

dl  =  pow ((doubte) (x(0] -x [2]) ,  2.0)  -t- 

pow  ( (doubte)  (y [0]  -y [2]) ,  2.0)  ; 

•  d2  =  pow( (doubte) (x[0] -x[  1  ]) ,  2.0)  + 

pow((doubla)(y[0]-y[1]),  2.0)  , 
if  ({dl  <  4  1)  ||  (d2  <  4.1))  { 

Ioc2(j][0]  =  x(0]  . 
loc2[j]{1]  =  y[0] ; 
i++ ; 

> 

(  for  (i  =  1  ;  i  <  max_pts-1  ;  ir-  +)  { 
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if(i==1){ 

for  (k  =  1  ;  k  <  5  ;  k++)  { 

x(k]  =  Ioc3[i+k-2][0]  ; 
y[k]  =  loc3[i+k-2][1]  ; 

> 

d2  =  pow((double)(x[1]-x[2]),  2.0)  + 

pow((boubte)(y[l]-y[2]),  2.0) ; 
d3  =  pow((doubfe)(x[3]-x[2J),  2.0)  + 

pow((double)(y[3]-y[2]),  2.0) ; 
d4  =  5.0 ; 

d5  =  pow((double)  (x[4J  -x[2J) ,  2.0)  + 

pow((double)(y[4]-y[2]),  2.0) ; 

> 

else  if  (i  =  =  max_pts-2)  { 

for  (k  =  0  ;  k  <  4  ;  k  +  +)  { 

x[k]  =  Ioc3[i  +  k-2][0]  ; 
yfk]  =  loc3{i+k-2][1]  ; 

} 

d2  =  pow((double)  (x[  1  ]  -x[2J) ,  2.0)  + 

pow((double)(y[1]-y[2]),  2.0)  ; 
d3  =  pow((double)(x[3]-x{21),  2.0)  + 

pow((double)(y[3I-y[2»,  2.0)  ; 
d4  =  pow((double)  (x[0)  -x[2]) .  2.0)  + 

pow  ( (double)  (y[0]-y  [2]),  2.0) ; 
d5  =  5.0  ; 

} 

else  { 

tor(k  =  0;  k  <  5;k  +  +)  { 

x(k]  =  Ioc3[i+k-2)[0]  ; 
y(k]  =  loc3(i+k-2](l] ; 

} 

d2  =  pow(  (double)  (x(2]-x(1  ]) ,  2.0)  + 

pow((double)  (y (2|-y (1  ]) ,  2.0)  ; 
d3  =  pow((double)(x[3]-x[2]),  2  0)  -i- 

pow((double)(y[3)-y[2]),  2.0)  ; 
d4  =  pow( (double)  (x[2)-x(0)),  2.0)  + 

pow((double)(y[2]-y[0]),  2.0)  ; 
d5  =  pow((double)  (x(4)-x{2)),  2.0)  + 

pow((double)(y(4]-y(2J),  2.0)  , 

} 

if  ((d2  <  4.1)  ||  (d3  <  4.1)  ||  (d4  <  4.1) 

II  (d5<  4.1))  { 

Ioc2[j](0]  =  x[2]  ; 
loc2(j](1]  =  y(2J  ; 

j++ ; 

} 

} 

for  (k  =  0  ;  k  <  3  ;  k+  +)  { 

x(k]  =  loc3[m«x_pts + k-3]  [0]  ; 
y(k)  =  loc3[max  jjts + k  -3]  [  1  ]  , 

} 

dl  =  pow((double) (x(0]-x(2j),  2.0)  + 

pow((double)(y{0]-y[2]),  2.0)  ; 

d3  =  pow((double)(x(1]-x{2]),  2.0)  + 

pow((doubl«)(y(1)-y(2]),  2.0)  ; 

H  ((dl  <  4.1)  ||  (d3  <  4.  !))  { 

IOC20HO)  =  x(2]  ; 
loc2[j][1]  =  y(2]  ; 

i++ ; 

> 
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fprintf  (to,  "\n\nAftar  elimination  of  transient*  (%d)  :\n\n",  0  ; 
)  for  (i  =  0 ;  i  <  j ;  i++)  { 

point  =  Ioc2[i][0)  +  loc2[i][1]  *  xsize  ; 
if  ((i%15)  ==0) 

fprinl  (fo,  “\n%3d  ",  point) ; 


fprintf  (fo,  “%3d  ",  point)  ; 

} 

for  (i  =  0  ,  i  <  j ;  i++){ 

Ioc3(i][0]  =  Ioc2[i][0)  ; 
loc3[i][1]  =  loc2[i][1]  ; 

i 

maxjjts  =  j ; 
j  =  0; 

for  (i  =  0  ;  i  <  max_pts  ;  i+  +)  { 
if  (i  =  =  0)  { 

for  (k  =  2  ;  k  <  5  ;  k++)  { 

x[k]  =  Ioc3[k-2][0] ; 
y[kj  =  loc3[k-2)[1] ; 
> 

dl  =  5.0  ;  02  =  5.0  ; 


<13  =  pow((double)  (x[3]  -x[2]) ,  2.0)  + 

pow((double)  (y  [3]  -y  [2]) ,  2.0)  ; 
d4  =  pow( (double)  (x[4]-x[2]),  2.0)  + 

pow((double)(y[4J-y[2J),  2.0)  ; 

> 

else  if  (i  ==  max  pta-1)  { 

for  (k  =  0  ;  k  <  3  ;  k  +  +)  { 

x(k]  =  Ioc3[i+k-2)[0]  ; 
y[k]  =  loc3[i+k-2][1] ; 

►  > 

dl  =  pow((double) (x[0]-x(2)),  2.0)  + 

pow((double)(y[0]-y[2]),  2.0)  ; 
d2  =  pow((double)(x[1]-x[2J),  2.0)  + 

pow((double)(y[1]-y[2J),  2.0)  ; 
d3  =  5.0  ;  d4  =  5.0  . 

> 

)  else  if  (i  ==  1)  { 

for  (k  =  1  ;  k  <  5  ;  k+  +)  { 

x(k]  =  Ioc3[i+k-2][0]  ; 
y[k]  =  loc3(i+-k-2][1]  ; 

> 

dl  =  pow((double)(x[1]-x[2]),  2.0)  + 

pow((double)(y(1]-y[2]),  2.0)  ; 

|  d2  =  5.0  ; 

f  d3  =  pow((double)(x[3]-x[2J),  2.0)  + 

pow((double)(y[3]-y[2]),  2.0)  ; 
d4  =  pow((double)(x[4]-x[2J),  2.0)  + 

pow((double)(y(4J-y[2]),  2.0)  ; 

> 

else  if  (i  =  =  max  pts-2)  { 

for  (k  =”0  ;  k  <  4  ,  k  +  +)  { 

*  x[k]  =  Ioc3[i+k-2][0)  ; 

y(k]  =  loc3[i+k-2][l]  ; 

} 

dl  =  pow((double)(x(1]-x[2)),  2.0)  + 

pow((double)(y[1J-y[2J),  2.0)  ; 
d2  =  pow((double)(x[0]-x[2]),  2.0)  + 

pow((double)(y[0)-y[2]),  2.0)  ; 

i  d4  =  5.0  ; 


neural* 
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neureM 


d3  =  pow((double)  (x[3J-x[2J) .  2  0)  + 

pow((double)(y[3]-y[2]),  2.0) ; 

} 

eiee  { 

for  (k  =  0  ;  k  <  5  ;  k++)  { 

x[k)  =  toc3[i+k-2][0] ; 
y(kj  =  loc3[i+k-2)[1) ; 

} 

dl  =  pow((double)(x(1]-x[2]),  2.0)  + 

pow((double)(y[l]-y[2]),  2.0) ; 
d2  =  pow(  (double)  (x(0]  -x[2]) ,  2.0)  + 

pow((doubte)(y[0]-y(2]),  2.0) ; 
d3  =  pow((douWa)(x(3]-x[2]),  2.0)  + 

pow((double)(y[3]-y[2]),  2.0) ; 
d4  =  pow( (double)  (x[4]  -x[2]) ,  2.0)  + 

pow  ( (double)  (y (4]  -y  [2)) ,  2.0)  ; 

} 

if  (((dl  <  4.1)  &&  (d3  <  4.1))  || 

((dl  <  4.1)  &&  (d2  <  4.1))  1 1 
((d3  <  4.1)  &&  (d4  <  4.1)))  { 

Ioc2[j][0]  =  x[2]  ; 
toc2li][l]  =  y[2] ; 
j++  ; 

} 

fprintf  (fo,"\n\n(Reduced  Trajectory]  Only  three  in  a  row!  (%d)\n  j)  ; 

for  (i  =  0  ;  i  <  | ;  I++)  { 

point  =  Ioc2[i][0]  +  loc2[i](1]  *  xeae  ; 
if  ((i%15)  =  =  0) 

fprintf  (fo,  “\n%3d  ",  point)  ; 

0l86 

fprintf  (fo,  “%3d  ",  point) ; 

} 

for  (i  =  0  ;  i  <  j ;  i++)  { 

Ioc3[i][0]  =  Ioc2(i][0]  ; 
loc3[i][1]  =  loc2[i][1] ; 

} 

maxjita  =  j ; 


if  (and  flag  =  =  0) 

create.andjile  (temp,  loc2,  max_pta,  fft.flag)  ; 


j  =  0  ; 

Ioc2[j][0]  =  Ioc3[i][0]  ; 
loc2[j][1]  =  loc3[j][1]  ; 
for  (i  =  1  ;  i  <  max  pta  ;  i+  +)  { 

if  ((Ioc3(i][0]  !=  Ioc2[j][0])  1 1 

(loo3{i](1]  1=  I0C2&]{1]))  { 
j++  ; 

1oc2(j][0]  =  Ioc3[i][0]  ; 

loc2[j][1J  =  locai'H1] ; 

> 

} 

j++  ; 

fprintf  (fo,  "\n\nNow  liating  final  trajectory!  (%d)\n",  j) ; 
for  (i  =  0  ;  i  <  j ;  i++)  { 

point  =  Ioc2[i](0]  +  loc2(i][1]  *  xaize  ; 
if  ((i  %  15)  =  =  0) 

fprintf  (fo,  "\n%3d  ",  point) ; 

elae 


B-44 


AppendteB.  Computer  Program 


nouraM 


Iprintf  (to,  “%3d  ",  point) ; 

> 

for  (I  =  0;  i  <  j ;  I++)  { 

Ioc3[i](0]  =  toc2[i][0]  ; 
loc3!i][1)  =  loc2[i][1]  ; 

> 

if  (oraph_ft«g  ==  1)  { 
max jjte  =  j ; 
sprintf  (subjitle, 

“Reduced  Trajectory:  %•  -->  %e“,  name2,  name) ; 
graph  Jest  (name) ; 
length  =  (ehort)  strlen  (aubjrtte)  ; 
draw_grid2  (ysize,  xsize,  aubjitle,  length)  ; 
draw_apaech_map  (max_pta,  loc2)  ; 

•cant  (“%e",a) ; 

clipoff  0  : 
graph  oft  0  ; 

> 

(close  (to) ; 

> 


graphjaat  (name) 

char  name[30] ; 

{ 

char  title[79],  labeix[79]  ; 

float  xloc[5]  *  {0.  639.0,  639.0,  0.0,  0.0}  ; 

float  yloc[5]  =  {349.0,  349.0,  0.0, 0.0.  349.0}  ; 

int  points  =  5  . 

inrt  ws_id  =  1  ; 

int  clearHag  =  1  ; 

short  length ; 


sprirrtf(title,"NEURAL4:  Kohonen  %d  x  %d  Neural  Net  --  %s". 
ysize,  xsize,  name) ; 

sprintf(labelx,  "Noise  Level :  %g",  noise)  ; 
graphon  0  . 

gks$clear_ws  (&wsjd,  &clear_flag)  ; 
gksSpolyline  (&points.  xloc,  yloc)  ; 
prepcolmat  (ysize,  xsize)  ; 
length  =  (short)  strlen  (title)  , 
outtitle  (title,  length)  ; 
length  =  (short)  strlen  (labeix)  ; 
outlabetx  (labeix.  length)  ; 
clipon  0  ; 
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$  link  autodtw, option*  file/opt 

r 

Routine*  which  ua*  a  first  Kohonen  neurai  net,  filee  generated  by 
autofft.exe  (I.*.  *.tm),  header  fitee  (*  hdr)  deacribing  the 
content*  of  the  *.tm  file*,  and  a  header  file  deacribing  the 
template*  to  perform  Ney'a  one  paaa  dynamic  time  warping  algorithm. 

The  algorithm  allow*  recognition  of  both  isolated  and  connected 
speech  without  changing  the  program.  Additionally,  the  stretch 
factor*  are  user  selectable.  0.75  and  0.75  are  auggeeted. 

A  grader  routine  automatically  score*  the  recognition  process 
from  the  data  given  in  the  *  hdr  filee.  Note  that  some  bugs 
may  still  exit  for  grading  isolated  digits.  Also  note  that 
the  grader  routine  gives  + 1  for  a  correct  digit,  -1  for  a  wrong 
digit,  -1  for  a  deleted  digit,  and  -.5  for  an  additional  digit. 

Recognized  periods  of  silence  are  ignored. 


V 

#  include  stdio 

#  include  math 

float  map[20][20][16]  ;  /*  output  node*  */ 

int  xsize,  ysize  ;  f*  Size  of  array  V 

int  number Jnputa ; 

float  aa,  bb ; 

char  training_file[30]  ; 

int  numjemplatea ; 

float  totaldigita , 

float  wrong_digits ; 

float  min_dist ; 

int  tem_array{50],  utt_arr*y[50] , 

int  t_ words  ; 

float  percent_corr,  cum _per_corr  ; 

main  0 

{ 

char  temp[30],  temp_file[30],  utt_file(30]  ; 

char  fjle_name[30),  fiie_descr[80]  , 

char  sub[l5][30]  ; 

FILE  “flog,  *fnet,  *fstd,  *fin,  *ftmp  ; 

char  template^  5]  [30] ; 

int  t_array[15][200][2],  u_array[2000][2],  t_length[15]  ; 

int  ujength,  dist,  r,  c,  i ; 

char  *std  =  ‘standard,  hdr"  ; 

int  entries_std,  entriea_cat ; 

int  i_std,  i_cat ; 


I  prirrtf  (An\nAUTODTW:  Tests  standard  set  of  utterances... \n\n")  ; 

printf  ("Enter  name  of  template  fils  [less  hdr]:  ")  ; 

scartf  ("%s",  temp) ; 

aprintf  (temp_file,  "%s.hdr",  temp) ; 

ftmp  =  fopen  (temp_file,  "r ")  ; 

fscanf  (ftmp,  ‘%d".  &num_tem plates)  , 

I  for  (i  =  0  ;  i  <  numjemplate*  ;  i  +  +) 
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autodtw 


> 


fscanf  (ftmp,  t*mpi*t*[i]) ; 

•do**  (ftmp)  ; 

print!  (“Enter  name  of  log  file  (add  .log]: ")  ; 

•cent  (“%*”,  temp) ; 
flog  =  (open  (temp,  “w") ; 

fprintf  (flog,  “Log  File:  %■  for  AUTOOTW.\n\n",  temp)  : 
print!  OnEnter  horizontal  weight:  '0  : 

•cant  r%f',  &aa) ; 

print!  (“Enter  vertical  weight:  ”) ; 

•cent  (“%f\  Abb)  ; 

fprintf  (flog,  “Horizontal  and  vertical  weights  ere  %g  and  %gAn", 
•a.  bb) : 

printf('V>Enter  name  of  net  to  uee  [ieea  net] :  “} ; 

acenf  ("%•",  temp)  ; 

sprint!  (trainingjile,  “%s.net",  temp) ; 

fnet  =  fopen  (traininjite,  “r") ; 

fscanf  (fnet,"%d  %d  %d",  Aysize,  Axsize,  &numb*r_inputs)  ; 
for  (r  =  0  ;  r  <  ysiz*  ;  r+  +)  { 

for  (c  =  0  ,  c  <  xsize  ;  c+ +)  { 

for  (I  =  0  ;  i  <  number Jnputs  ;  i++)  { 

fscanf  (fnet,"  %f",  Amep(r][c](i]) ; 

> 

> 

} 

(close  (fnet)  ; 

for  (i  =  0  ;  i  <  numtem  plates  ;  i+  +)  { 

get_vectors(templete[i],  At_array [i]  [0]  [0], 

&t_length(i])  ; 

print!  (“  %e  ie  %d  vectors  long\n".template[i], 
t  length(ij)  ; 

} 

fprintf (ftog.'ViDynamic  Time  Warping  using  %s\n",training_file); 

fstd  =  fopen  (std,  “r”)  ; 

fscanf  (fstd,  "%d",  Aentriesstd)  ; 

for  (i_std  =  0  ;  i_std  <  entries_std  ;  i_std  +  +)  { 

fscanf  (fstd,  "%a  %a",  file_name,  file_descr) ; 

print!  ("\n%s\n",  file_descr)  ; 

total_digits  =  0.0 ; 

wrong_digits  =  0.0  ; 

fprintf  (flog,  "\n%8\n",  file_descr)  ; 

fin  =  fopen  (file_name,  “r") ; 

fscanf  (fin,  "%d",  &entries_cat)  ; 

for  (i_cat  =  0  ;  i_cat  <  entries_cat ;  i_cat+  +)  { 

fscanf  (fin,  "%•  %d",  utt_file,  &t_words)  ; 
for  (i  =  0  ;  i  <  t_words  ;  i+  +) 

fscanf  (fin,  "%d",  &tem_arrayli])  ; 
get_vectors(utt_file,  u_array,  &u_length) ; 
print!  (“  V12s  is:  ", 
utt_file)  ; 

fprintf  (flog,"  %-12s  is:  ", 
utt_file)  ; 

cdtw  (t  array, u  array ,t  length,  u  length, flog)  ; 

} 

fclose  (fin)  ; 

> 

fclose  (fstd) ; 

(close  (flog) ; 


« 
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autodtw 


cdter  ((array,  u  array,  t  length,  u  length,  flog) 

int  t_arr*y[l5] [2001(2],  u_array[2000][2]  ; 

in*  t  Iength[l5].  u  length  ; 

FILE  *flog ; 


float  accum_dtat[2][l5][200] ; 

int  utteranc*[50] ; 

int  ptr,  b _ptr ; 

int  back_ptr[2][15][200]  ; 

int  from_tempiate[2000] ; 

int  from_frame{2000] ; 

int  i,  j,  k,  kk ; 

float  dl,  cJ2.  d3,  diet ; 

float  mindist ; 


ptr  =  0 ; 

for  (k  =  0  ;  k  <  numtemplate*  ;  k+  +)  { 

for  (j  =  0 ;  j  <  t  length[k) ,  j+ +)  { 
if  0  =  =  0)  { 

accum_dist[ptr]  [k]  [j]  =  [diet  = 

ab*(u_array[01[0]-  t_array[kl[i][0])  + 
ab*(u_array[0]C11-  t_array[kl[fl[1])); 

} 

els*  { 

accum_diat[ptr][k][j]  =  (diet  +=  bb  •  ( 

abs(u_array[0][0]  -  t_array[k)[j][01)  + 
abs(u_*rray(01(tl  -  t_array[k][j][ll))); 

> 

back  ptr  [ptr]  [k][j]  =  0  ; 

> 

> 

tor  (i  =  1  ;  i  <  u  length  ;  i++)  { 
if  (Ptr  =  =  0)  { 

ptr  =  1  ; 
b_ptr  =  0 ; 

> 

else  { 

ptr  =  0 ; 
b_ptr  =  1  ; 

} 

for  (k  =  0  ;  k  <  num  template*  ;  k+  +)  { 
for  (j  =  0  ;  j  <  tjengthfkj ;  j+  +)  { 

diet  =  abs(u_array[i][0]  •  t_arrey[k)[j][0])  + 

abs(u_array[i][1]  -  t_array[k][j][1])  ; 
ifO==0){ 

min_dist  =  99999.0  ; 

for  (kk  =  0  ;  kk  <  numjemplatee  ;  kk  +  +)  { 

if  (min_dist  > 

accum_dist[b_ptr]  [kk]  [t_length[kk]  - 1  ]) 
min_dist  = 

accum  dist[b_ptr][kk][t  length[kk]-1], 

> 

if  (accum_dist[b_ptr][k][0]  <  min_dist)  { 

accum_dist[ptr][k][0]  =  aa  *  dist  + 
accum_dist(b_ptr][k][0] ; 
back_ptr[ptr][k][0]  = 
back~ptr(b  ptr][k][0] ; 

> 

else  { 
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accum_diat!ptr][k][0]  = 
min_dtat  +  d M  ; 
beck_ptr(ptr]!k][0]  =  i-1  ; 

> 

} 

•toe  { 

dl  =  accum_di«t(b_ptr](kj[j-l]  +  diet ; 
d2  =  accum_di«t(ptr][k](j-1]  +  (bb  *  diet)  ; 
d3  =  eccum  dietfb _ptr)[k](jj  +  (ee  *  diet)  ; 
if  (d2  <  =  d3~&&  d2  <  dl)  { 

accum_dist[ptr]!k][j]  =  d2 ; 
beck_f5r{p«r]{k}QJ  = 

beck_ptr[ptr][k][j-1]  I 

> 

eiee  if  (d3  <  =  d2  &&  d3  <  dl)  { 

•ccum_diet[ptr][kl{fl  =  d3 ; 

beck_ptr[ptr][k)(j]  * 

beck_ptr[b_ptr}[k)[fl ; 

} 

eiee  { 

accum_diet(ptr][k][j]  =  dl ; 
beckj5r[ptrj[kj(j]  = 

beck_ptr[bjJtr][k]D-1) ; 

> 

> 

} 

> 

min_dist  =  99999.0  ; 

for  (k  =  0  ;  k  <  numjemplatee  ;  k  +  +)  { 

if  (min_diet  >  accum_dist[ptr](k)[t_lenQth[k)-1])  { 

min_dist  *  accum_di«t[pt r]  [k]  [t_length[kl - 1  ]  ; 
kk  =  k ; 

} 

> 

from_template[i]  =  kk  ; 

from  frame[i]  =  back_ptr[ptr][kkj[t  length[kkj-1) ; 

} 

ptr  =  ujength  - 1  ; 

i  =  -1  ;~ 

while  ((ptr  >  0)  &&  (i  <  49))  { 

utterance! ++i]  =  from_template[ptr]  ; 
ptr  =  from  frame[ptr] ; 

> 

k  =0; 

for  (j  =  i ;  j  >  =  0 ;  j~)  { 

if  (utterance(j]  =  =  10)  { 
printf  ("..  ”)  ; 
fprintf  (flog,  ")  ; 

> 

etee  { 

printf  ("%d  ",  utterancejj])  ; 
fprintf  (flog,  "%d  ",  utterance!}]) ; 
utt  array[k  +  +]  =  utterance!}]  ; 

>  " 

} 

printf  ("\n  Should  be:  ")  ; 
fprintf  (flog,  "\n  Should  be:  ")  ; 
for  (j  =  0  ;  j  <  t_worde  ;  j+  +)  { 

printf  ("%d  ",  tem_array[j])  ; 
fprintf  (flog,  “%d  ",  tem_array(j]) ; 
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> 

grader  (tem_array,  utt_array,  t_worda,  k) ; 
printf  ('Vi  correct  =  %5.3f  cum_correct  =  %5.3fui", 
percent_corr,  cum_per_corr) ; 
fprintf  (flog,  “\n  correct  =  %5.3f  cum_correct  =  %5.3 An", 
percent_corr,  cum _per_corr) ; 


mindiet  (map.  inp,  close) 
double 
int 
float 

{ 

int 

double 

double 


inp{16] ; 
close (2] ; 
map[20][20][16]  ; 

r.  c,  i ; 

dotjsroduct ; 
maximum  =  0.0 ; 


tor  (r  =  0  ;  r  <  yaize  ;  r+  +)  { 

for  (c  =  0  ,  c  <  xsize  ;  c+  +)  { 
dot  ^product  =  0.0  : 
for  (I  =  0  ,  i  <  number Jnputa  ;  i++) 
dot_product  +=  inp(i]  *  map(rl(cl(i]  ; 

If  (dot_product  >  maximum)  ( 
maximum  =  dot  ^product ; 
cloee[0]  =  c ; 
cloee[lj  =  r ; 

> 


getj/ectors  (name,  array,  length) 


char 

name[30]  ; 

int 

array  (20001(2)  ; 

int 

•length ; 

int 

flag,  r,  c,  i,  j.  k  ; 

double 

,  in(  1 6] .  dl,  d2.  d3.d4.d5; 

float 

element ; 

inf 

Ioc2[2000][2),  Ioc3[2000][2] 

FILE 

*fsnd  ; 

int 

sound,  point,  x[5].  y[5]  ; 

int 

max_pts  . 

fsnd  = 

fopen  (name,  "r")  ; 

sound 

i  =  0. 

=  0; 

flag  = 

0; 

while  (flag  1=  1)  { 

fscanf  (fsnd,  “%f".  &element)  ; 
if  (feof(fsnd) !  =0)  { 


flag  =  1  ; 

} 

else  { 

in[i]  =  (double)  element ; 
i++  ; 

} 

if  ((i  ==  15)  &&  (flag  ==  0))  { 
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mindwt  (map,  in,  &Joc2[soundl[0]) ; 
i  =  0; 
sound +  + ; 

> 

} 

(close  (fend) ; 

(or  (i  =  0 ;  i  <  sound ;  I++)  { 

point  =  Ioc2[i][0]  +  loc2[i][1]  *  xsiza  ; 

> 

(or  (I  =  0 ;  i  <  sound  ;  I++)  { 

Ioc3[i][0]  =  Ioc2[i](0]  ; 
loc3[i][1]  =  loc2tn[11 ; 

} 

max_pts  =  sound ; 

i  =  0; 

#()I=P) 

max_pts  =  j ; 

i  =  o ; 

for  (k  =  0 ;  k  <  3  ;  k++){ 

x[k]  =  loc3[k]  [0] ; 
y[k]  =  loc3[k][1J , 

} 

dl  =  pow(  (double)  (x(0)  -x[2],  2.0)  + 

pow((doubls)(y[0)-y(2]),  2.0)  ; 
d2  =  pow((doubls)(x[0]-x[1]),  2.0)  + 

pow(  (double)  (y [0]  -y ( 1  ]) ,  2.0) ; 
i»((d1  <  4.1)  ||  (d2  <  4.1))  { 

Ioc2[j][0]  =  x(0]  , 

'oc2[j](1I  =  y(0] ; 

j++; 

> 

(or  (i  =  1  ;  i  <  max  pts-1  ;!++){ 

«(!==  m 

(or  (k  =  1  ;  k  <  5  ;  k++)  { 

x[k]  =  Ioc3(i+k-2][0]  ; 
y(k]  =  loc3(i+k-2][i] ; 

> 

d2  =  pow((doubie)(x(1]-x[2]),  2.0)  + 

pow((doub(e)(y[1J-y[2J),  2.0) ; 
d3  =  pow((double)(x(3]-x(2j),  2.0)  + 

pow((double)(y(3]-y[21),  2.0)  ; 
d4  =  5.0  ; 

d5  =  pow((double)  (x(4]-x(2|),  2.0)  + 

pow((double)(y[4]-y[2]),  2.0)  ; 

> 

else  if  (i  =  =  max_pts-2)  < 

for  (k  =  0 ,  k  <  4  ,  k++)  { 

x(k]  =  Ioc3[i+k-2][0]  ; 
y(k]  =  loc3(i+k-2)(1] ; 

} 

d2  =  pow((double)(x[1]-x[2]),  2.0)  + 

pow((doubla)(y[l]-y(2)),  2.0) ; 
d3  =  pow((doubla)  (x[3]-x[2|) ,  2.0)  + 

pow{(doubls)(yI3)-y[2J),  2.0)  ; 
d4  =  pow((double)  (x(0]  -x(2]) ,  2.0)  + 

pow((doubl«)(y(0]-y(2]),  2.0) ; 
d5  =  5.0 ; 

> 

ales  { 
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for (k  ^0;k<  5;  k++)  { 

x[k]  =  k>c3[i  +  k-2]  [0]  ; 
y[kj  =  loc3{i+k-2]{1] ; 

> 

62  =  pow((doubte)  (x[2]-x[1  ]) ,  2.0)  + 

pow((doubte)  (y  [2]  -y [  1  ]) ,  2.0) 

63  =  pow((doubJ*) (x[3]  -x(2J) ,  2.0)  + 

pow((doubl*)  (y (3)  -y (2)) ,  2.0) 

64  =  pow((doubte)(x[2]-x[0]),  2.0)  + 

pow((doubte)  (y  [2]  -y  (0J) ,  2.0) 
d5  =  pow((doubte)  (x(4]-x[2]) ,  2.0)  + 
pow((doubte)  (y  [4]-y[2]) ,  2.0) 

i 

if  ((d2  <  4.1)  ||  (63  <  4.1)  1 1  (64  <  4.1) 

1 1  (65  <  4.1))  { 

Ioc2(j](0]  =  x[2]  ; 

IOC2UH1]  =  y{2] ; 

i++ ; 

> 

} 

for  (k  =  0  ;  k  <  3  ;  k++)  { 

x[k]  =  Ioc3[max_pts+k-3][0]  ; 
y[k]  =  loc3[max _pte+k-3](1] ; 

> 

dl  =  pow((6oubl*)(x[0]-x[2]),  2.0)  + 

pow(  (double)  (y  [0]  -y  [2]) ,  2.0)  ; 

63  =  pow((doubte)(x[1]-x(2]),  2.0)  + 

pow((doubte)(y[1]-y[2J),  2.0)  ; 
if  ((dl  <  4.1)  1 1  (63  <  4.1))  { 

Ioc2[j][0]  =  x[2]  ; 

kxxwm  =  y[2J  ; 

J++ ; 

> 

for  (i  =  0  ;  i  <  j  ;  i+  +)  { 

point  =  Ioc2[i][0]  +  loc2[i][1]  *  x«iza  ; 

> 

for  (i  =  0;  i  <  j ;  i++)  { 

Ioc3[i][0]  =  Ioc2[i][0) ; 
loc3[i)(1)  =  loc2[i)[1)  ; 

> 

max _p»a  =  j  ; 
i  =  0; 

for  (i  =  0  ,  i  <  max_pt8  ;  i+  +)  { 

if  (i  ==0)  { 

for  (k  =  2  ;  k  <  5  ,  k+  +)  { 

x[k]  =  Ioc3[k-2][0]  ; 
y[k]  =  loe3{k-2J{1] ; 

> 

dl  =  5.0  ;  d2  =  5.0  ; 

63  =  pow((doubia)(x[3]-x[2]),  2.0)  + 

pow((double)(y[3)-y[2J),  2.0) ; 

64  =  pow((double)(xt4]-x[2]),  2.0)  + 

pow((double)  (y  [4]  -y (2]) ,  2.0)  ; 

} 

•Is*  if  (i  =  =  max_pts-1)  { 

for  (k  =  0  ;  k  <  3  ;  k  +  +)  { 

x[k]  =  loc3(i+k-2](0J  ; 
y(k]  =  loc3[i+k-2][1J  ; 

> 
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dl  =  pow((doubie)  (x[0)  -x[2]) ,  2.0)  + 

pow((doubie)  (y  (0]-y  [2]) ,  2.0) ; 
d2  =  pow(  (double)  (x[  1 )  -x£2J),  2  0)  + 

pow((doubfe)(y(1J-y(2]),  2.0) ; 
d3  =  5.0 ;  d4  =  5.0  ; 

> 

alee  if  (l  ==  1)  { 

for  (k  =  1  ;  k  <  5  ;  k  +  +)  { 

x(k]  =  Ioc3li+k-2][0] ; 
y(k)  =  loc3(i+k-2](1] ; 

} 

dl  =  pow((double)  (x(  1 )  -x(2]) ,  2.0)  + 

pow((double)  (y (1  ]  -y  (2J) ,  2.0) ; 
d2  =  5.0 ; 

d3  =  powf(double)  (x[3]  -x[2]) ,  2  0)  + 

pow((double)  (y(3J  -y [2]),  2.0) ; 
d4  =  pow((double)(x[4]-x(2]),  2.0)  + 

pow((double)(y[4]-y[2]).  2.0)  ; 

> 

else  if  (i  =  =  mex _pts-2)  { 

for  (k  =  0  ;  k  <  4  ;  k  +  +)  { 

x(k]  =  Ioc3(i+k-2][0]  ; 
y[k]  =  loc3(i+k-2](1]  ; 

> 

dl  =  pow((double)(x[1]-x[2]),  2.0)  + 

pow((double)  (y (1  ]  *y (2)) ,  2.0)  ; 
d2  =  pow((double)(x(01-x[2J),  2.0)  + 

pow((double)(y[0]-y[2J),  2.0)  ; 
d4  =  5.0  ; 

d3  =  pow((double)  (x(3]  -x[2]),  20)  -t- 

pow((doubl»)  (y[3]  -y(2}) ,  2.0) , 

> 

else  { 

for  (k  =  0  ;  k  <  5  ;  k  +  +)  { 

x[k]  =  Ioc3[i  +  k-2][0]  , 
y[k]  =  loc3(i  +  k-2][1J  ; 

> 

dl  =  pow((double)(x(1]-x[2J),  2.0)  + 

pow((double)(y(1]-y[2J),  2.0)  ; 

d2  =  pow((double)(x[0]-x[2]),  2.0)  + 

pow((double)(y(0]-y(2J),  2.0) ; 
d3  =  pow((double)(x[3J-x[2)),  2.0)  + 

pow((double)(y[3]-y{2]),  2.0)  , 
d4  =  pow((double)(x(4]-x[2]),  2.0)  + 

pow((double)(y[4)-y[2J),  2.0)  ; 

} 

if  (((dl  <  4.1)  &&  (d3  <  4.1))  1 1 

((dl  <  4.1)  &&  (d2  <  4.1))  || 

((d3  <  4.1)  &&  (d4  <  4.1)))  { 

Ioc2(j](0]  =  x[2]  ; 
loc20)H)  =  y(2]  ; 
i++ ; 

} 

} 

•length  =  j ; 

for  (i  =  0  ;  i  <  j ;  i+  +)  { 

array (i](0]  =  Ioc2[i][0] ; 

array[ij(l]  =  loc2[i][l] ; 

} 
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grader  (t_arr«y,  u_array,  tjength,  ujength) 
int  t_array[50J,  u_array[50] ; 

int  t  length,  u  length  ; 

i 

int  i,  j,  ptr,  b_ptr ; 

float  back _ptr[2][50] ; 

float  d,  min,  diet,  beck  ; 

beck  =  0.0 ; 
ptr=1; 

for  (i  =  0  ;  i  <  ujength  ;  i++)  { 
if  (ptr  ==  0){ 

b j)tr  =  0 ; 
ptr  =  1  ; 

> 

else  { 

b_ptr  =  1  ; 
ptr  =  0 ; 

> 

if  (i  =  =  0)  { 

for  (j  =  0  ;  j  <  tjength  ;  j+ +)  { 

it  (t_array[fl  =  =  u_array(0}) 
diet  =  0.0  +  back  ; 

else 

dist  =  1.0  +  back  ; 
back  =  dist  ; 
back_ptrlptr][j]  =  dist ; 

> 

} 

else  { 

for  (j  =  0  ;  j  <  tjength  ;  j+  +)  { 

if  (t_array(j)  =  =  u_array{i]) 
dist  =  0.0 ; 

else 

dist  =  1.0; 
if  0  =  =  0) 

beck  ptr(ptr][0j  =  back_ptr[bj>tr][0]  + 
(0.5  *  dist) . 

else  { 

min  =  back_ptr[b_ptr][j]  +  (0.5*dist) ; 
d  =  back_ptr[b_ptr][j-1)  +  dist ; 
if  (d  <  min) 

min  =  d  , 

d  =  back_ptr(ptr][j-11  +  dist ; 
if  (d  <  min) 

mi n  =  d  ; 

back  ptr[ptr]Q]  =  min  ; 

} 

} 

} 

> 

if  (ujength  >  0) 

min_di8t  =  back_ptr(ptr]  (tjength- 1  ]  ; 

else 

minjjist  =  tjength  ; 

percent_corr  =  (tjength  •  min_dist)  /  tjength  ; 
total  digits  +  =  tjength  ; 
wrong_digit8  +  =  min_dist  ; 

cum _per  corr  =  (total  digits  -  wrong  digits)  /  total  digits  ; 

> 
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$  link  twokoh4,nweight8, options  tile/ opt 

r 

••*•••»»«•<••••••»»»•»»••  tWOkoM.C  **•***•••••••**•**••• 

Routine*  to  train  a  second  Kohonen  net  to  proceea  reduced 
trajectories  from  drat  kohonen  net.  Number  of  point*  in  the 
trajectory  is  75.  Each  point  ia  represented  aa  a  scalar  from  0 
to  224.  Short  trajectories  are  filled  with  trailing  0‘a. 


*/ 


Capt  Gary  Bar  more,  8  Jul  88 


#  include  math 

#  include  stdio 

#  include  time 


float  map[20][20](225]  ;  /*  output  nodes  */ 
double  input[225]  ;  /*  input  nodes  */ 
double  gain,  noise ; 
double  mcount ; 
double  percent ; 


int  closest[2] ;  /*  closest  node  */ 

irrt  neigh[2] ;  /*  neighbor  */ 

int  nrangex,  nrangey  ;  /*  neighbor  range  */ 

int  nfactorx,  nfactory  ;  I*  neighbor  factor  */ 

long  count ;  /*  #  of  iterations  */ 

int  graph  ;  /*  #  between  plots  V 

int  seed ; 

int  maxneighx,  maxneighy  ;  /*  Starting  area  */ 

int  minneighx,  minneighy  ;  /*  Final  area  •/ 

int  xsize.  ysize  ,  /*  Size  of  array  V 
int  number_input8 ; 


char  training_file[30],  net_file[30],  first_net_file[30]  ; 

char  temp_file[l5] ; 

char  net_name[15]  ; 


init  (map) 
{ 


struct  curve  { 


int 

typ«. 

double 

maxgain 

double 

mingain 

double 

midgain 

int 

midtime 

}  gcurve ; 

struct  fig  { 


irrt  rnd  in  ; 

>"ag; 

float 

map  [20)  [20]  [225]  ; 

int 

r,  c,  i ; 

float 

max  rand  =  pow(2.0,  31.0)  -  10 

for  (r  = 

0  ;  r  <  ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  xsize  ;  c+  +)  { 

for  (i  =  0  ;  i  <  number Jnputs  ;  i+  +) 


twokoh4 
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map[rj[c](ij  =  rand  0  /  max  rand  ; 

> 


mindiat  (map,  inp,  close) 
double 
int 
float 

{ 

int 

double 

double 


inp[225]  ; 
cloee[2] ; 

map  [20]  [20]  (225]  ; 

r.  c,  i ; 

dist ; 

minimum  =  999999.0  ; 


for  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  xsize  ;  c+  +)  { 
dist  =  0.0 ; 

for  (i  =  0  ;  i  <  numberjnputs  ;  i  +) 
dist  +  =  pow  (inp[i]  -  map[r][c][i],  2.0)  ; 
if  (dist  <  minimum)  { 

minimum  =  dist  ; 
close[0]  =  c  ; 
cloae[lj  =  r ; 

> 


userinp  0 

{ 

int 

int 

struct  tm 
int 


line  ; 
c  ; 

•localtimeO,  *time  ; 
•bintim  ; 


do  { 

printf  ("TWOKOH4  net  training  (no  graphics)...  \n\n")  ; 


printffEnter  size  ‘m  n'  (for  an  m  x  n)  of  array  =  ?  [int  int)  ")  ; 
scanf("%d  %d",  &ysize.  &xsize)  ; 
if  (ysize  <  2) 

ysize  =  2  ; 
else  if  (ysize  >  20) 

ysize  =  20 ; 
if  (xsize  <  2) 

xsize  =  2  ; 
else  if  (xsize  >  20) 

xsize  -  20  ; 


printf  (“Do  you  want  0)  sequential  training, \n”)  , 
printf  ("  1)  randomized  training?  ")  ; 

1  scanf  ("%d",  &flag.rnd_in)  ; 

printf  (“Enter  name  of  header  file  containing  words  (less  hdr):  ")  ; 

scanf  ("%a",  tempjile)  ; 

sprintf  (trainingjile,  “%s.hdr",  tempjile)  ; 

numberjnputs  =  75 ; 

i  printf  ("Enter  name  of  pre-processor  Kohonen  net  file  [less  net]: ")  ; 
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ingain  Q 

{ 


scant  (“%s",  netname)  ; 

sprintf  (first_net_file,  “Ns.net”,  net_name) ; 

printff'Enter  name  of  net  file  to  create  [less  .net]:  ") ; 

scant  (“%a",  net_name)  ; 

sprintf  (net_file,  “%a.net“,  net_name) ; 

printf  (“Number  of  iterations  =  ?  (irrt]  ")  ; 
scant  ("%kr,  &count) ; 
if  (count  <  =  10  1 1  count  >  130000) 
count  =  100 ; 
mcount  =  (double)  count ; 

printf  (“Number  of  iterations  between  status  messages  =  ?  [irrt]  “) ; 
scant  (“%d",  &graph) ; 
if  (graph  <  1  1 1  graph  >  count) 
graph  =  10 ; 


ingain  0  ; 

printf  ("Starting  size  of  neighborhoods  yn  xn'  =  ?  [irrt  int] ")  ; 
scant  (“%d  %d",  &maxneighy,  Amaxneighx)  ; 
if  (maxneighx  <  2  1 1  maxne ighx  >  xsize  - 1) 
maxneighx  =  2  ; 

if  (maxneighy  <  2  1 1  maxneighy  >  ysize  ■  1) 
maxneighy  =  2  ; 

printf  ("Final  si2e  of  neighborhoods  yn  xn’  =  ?  [int  int]  ")  ; 
scant  (“%d  %d",  &minneighy,  &minneighx)  ; 
if  (minneighx  <  1  1 1  minneighx  >  maxneighx) 
minneighx  =  1  ; 

if  (minneighy  <  1  1 1  minneighy  >  maxneighy) 
minneighy  =  1  ; 


printf 

(“Initial  seed  for  random  #  generator  (0  SELECTS  TIME)  =  ?  [int]  "); 
scanf  (“%d",  &seed)  ; 
if  (seed  =  =  0)  { 

time  =  localtime  (bintim)  ; 
time.tm_sec  %=  60  ; 
time.tm_min  %=  60  ; 
seed  =  time.tm  sec  *  time.tm  min  ; 

> 

srand  (seed)  ; 

printf  (“Ready  to  begin?  (y/n)  ")  ; 

while  ((c  =  gate  (stdin))  =  =  "  1 1  c  =  =  '\n'  1 1  c  =  =  "\t") 

}  while  (c  !  =  "y")  i 


int  line ; 

printff'For  gain  enter  0)  LINEAR,  1)  SIGMOIDAL,  2)  PIECEWISE  LINEAR  :  "); 
scant  ("%d’’,  &gcurve  type)  ; 


if  (gcurve.type  =  =  0  1 1  gcurve.type  ==  1)  { 
printf  (“Maximum  gain  =  ?  [float]  ")  ; 
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•cant  {"%£”,  &gcurve.maxgain) ; 
if  (gcurve.  max  gain  >=  1.0  1 1  gcurve.maxgain  <  =  o.O) 
gcurve.maxgain  =  99 ; 

printf  ("Minimum  gain  =  ?  [float]  ")  ; 
scar  if  ("%E",  &  gcurve.  mingain)  ; 
if  (gcurve. mingain  <=0.0  1 1  gcurve.  mingain  >=  VO) 
gcurve.  mingain  =  0.0  ; 

> 

else  { 

printf  (“First  segment  starting  gain  =  ?  [float]  ") ; 
scant  (“%E",  &gcurve.maxgain) ; 
if  (gcurve.maxgain  >  =  10  1 1  gcurve.maxgain  <  =  0.0) 
gcurve.maxgain  =  .99 ; 

printf  ("Second  segment  starting  gain  =  ?  [float]  ")  ; 
scant  ("%£",  &gcurve.midgain)  ; 
if  (gcurve.midgain  <=0.0  1 1  gcurve. midgain  >=  1.0) 
gcurve. midgain  =  0.0  ; 

printf  ("Second  segment  starting  iteration  =  ?  [float]  ")  ; 
scant  ("%d",  &gcurve. midtime)  ; 
if  (gcurve.midtime  <  =  0  1 1  gcurve. midtime  >  count) 
gcurve.  mkttime  =  count  /  2  ; 

gcurve. mingain  =  0.0  ; 

} 


getgain  (0 

long  i ; 

{ 

if  (gcurve.type  =  =  0) 

gain  =  (percent  *  (gcurve.maxgain  -  gcurve. mingain))  + 
gcurve.mingain  ; 
else  if  (gcurve.type  =  =  1) 

gain  =  0.9  *  (gcurve.maxgain  -  gcurve.mingain)  /  (1 .0  +  exp  (i  - 
count  /  2.0))  +  .1  ; 

else  { 

if  (i  <  gcurve.midtime) 

gain  =  gcurve.maxgain  *  (1.0  -  (double)  i  /  gcurve.midtime) 

else 

gain  =  gcurve.midgain  *  (1.0  -  (double)  i  /  count)  ; 

} 

> 

save  net  0 

{ 

int  r,  c,  i ; 

FILE  *fnet ; 

fnet  =  fopen(net_file,"w") ; 

fprintf  (fnet,"%d  %d  %d",  ysize,  xsize,  numberjnputs)  ; 
for  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  xsize  ;  c+  +)  { 

for  (i  =  0  ;  i  <  numberjnputs  ;  i  +  +)  { 

fprintf  (fnet,"  %f",  map[r][c][i))  ; 

} 

> 
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> 


fcloee  (fnst) ; 


main  0 
{ 


long 

char 

irrt 

int 

FILE 

extern  unsigned 


•1(10] : 
ws_id  =  1  ; 
clear  flag  =  1; 
*tf;  ’ 

_stklen  ; 


stklen  =  8192 ; 

userinp  0  ;  /*  Get  input  values  */ 
nfactorx  =  maxneighx  ■  minneighx  +  1  ; 
nfactory  =  maxneighy  -  minneighy  +  1 ; 
init  (map) ;  /*  Initialize  weights  */ 
readjmjile  Q  ; 


for  (i  =  1  ;  i  <  =  count ;  i+  +)  { 
if  (i  %  graph  =  =  0)  { 

print!  (“TVZOKOH4:  gain  =  %f,  yrange  =  %d,  ”, 
gain,  nrangey) ; 

print!  (“xrange  =  %d,  iteration  #  %d",  nrangex.i)  ; 
print!  (”  (of  %ld)\n",  count)  ; 
if  (access  (net_file,0)  =  =  0) 
delete  (net_!ile)  ; 
save_net  0 
} 

percent  =  (mcount  -  0  /  mcount , 
getgain  (i)  ; 
if  (flag.rndjn  =  =  0) 
getin  0  ; 

else 

get_rnd_in  0  ; 

mindist  (map,  input,  closest)  ; 
if  (gcurve.type  !  =  2)  { 

nrangex  =  minneighx  +  percent  *  nfactorx  ; 
nrangey  =  minneighy  +  percent  *  nfactory  ; 

> 

else  if  (i  <  gcurve.  midtime)  { 

nrangex  =  minneighx  +  nfactorx  * 

((double)  (gcurve.midtime  •  i))  /  gcurve. midtime  ; 
nrangey  =  minneighy  +  nfactory  * 

((double) (gcurve. midtime  -  i))  /  gcurve.midtime  , 

> 

else  { 

nrangex  =  minneighx ; 

'•  nrangey  =  minneighy  ; 

> 

neigh[0]  =  nrangex  ; 
neigh(lj  =  nrangex , 
weightem  (map) ; 

> 

save_net  0  ; 

printf  ("\nNel  file;  %s  saved!\n",  net  file)  ; 

> 


twokoM 


nweightS.c 
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Thee#  routines  allow  training  and  testing  of  a  second  Kohonen 
net  of  two  net  system.  Inputs  srs  75  point  reduced  traiectoriee 
from  the  first  net.  Each  point  ia  a  scalar  from  0  to  224.  Short 
traiectoriee  are  filled  with  trailing  0's. 


#  include  math 

#  include  stdio 

#  include  stot 


extern  double 

input[22S]  ;  /*  input  node*  •/ 

extern  double 

gain ; 

extern  int 

closest[2] ;  /*  closest  node  */ 

extern  int 

neigh{2] ;  /*  neighbor  */ 

extern  int 

xsize,  ysize  ;  /*  Size  of  array  */ 

extern  int 

numberjnputs ; 

extern  char 

training_file{30]  ; 

extern  char 

first_net_fileI30] ; 

int 

number_disc rates ; 

int 

word  counter  ; 

int 

num  words ; 

char 

word_number[  1 00]  [  1 5]  ; 

i  it 

f_y8ize,  f  xsize,  f  number  inputs  ; 

Moat 

f_map[20]  (20]  [16]  ; 

read  trn_file  0 

{ 

FILE  *tf,  fnet ; 

int  i,  r,  c  ; 


tf  =  fopen  (training_file,  “r”) ; 
fscanf  (tf,  "%d",  &num_words)  ; 
for  (i  =  0  ;  i  <  num_words  ;  i  +  +) 

fscanf  (tf,  “%8",  word_number[i])  ; 
fclose  (tf)  ; 
word_counter  =  0 ; 

fnet  =  fopen  (first_net_file,  “r")  ; 

fscanf  (fnet,  "%d  %d  %d",  &f_ysize,  &f_xsize,  &f_number_inputs) ; 
for  (r  =  0  ;  r  <  f_ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  f_xsize  ;  c  +  +)  { 

for  (i  =  0  ;  i  <  f_number_inputs  ;  i  +  +)  { 

fscanf  (fnet,"  %f",  &f  map[r][cl[i])  ; 

> 


getin  0 

{ 

if  (word_counter  =  =  num_  words) 
word_courrter  =  0  ; 
read_word  (word_counter)  ; 
word  counter  +  +  ; 

> 


twofcoh4 
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get  md  in  0 
{  ' 

int  i ; 

double  m*x_rand  =  pow  (2.0,  31.0)  - 1.0  ; 

int  pointer ; 

pointer  =  floor  ((randO  *  (num_word*  -  .0001)  /  m*x_r*nd))  ; 
read  word  (pointer) ; 

> 

weightem  (map) 

float  m*p(2Ql(20](225] ; 

{ 

int  n right,  nlelt,  nup,  ndown,  r ,  c,  i ; 

if  (neigh[0]  >  0  &&  neigh[1]  >  0)  { 

nright  =  clos*st[0]  +  neigh [0]  •  1  ; 

U  (nright  >  =  xsize) 

nright  =  xsize  - 1  ; 
nleft  =  closest[0]  -  neigh(0]  +  1  ; 
if  (nleft  <  0) 

nleft  =  0 ; 

nup  =  closest[l]  -  neigh[1]  +  1  ; 
if  (nup  <  0) 

nup  =  0 ; 

ndown  =  clos**t[1]  +  neigh[1]  - 1  ; 
if  (ndown  >  =  ysize) 

ndown  =  ysize  •  1  ; 

> 

else  { 

nright  =  closest[0] ; 
nleft  =  closest[0]  ; 
nup  =  doeest[1] ; 
ndown  =  closest!  1]  ; 

} 

for  (r  =  nup;  r  <  =  ndown  ;  r+  +)  { 

for  (c  =  nleft ;  c  <  =  nright ;  c  +  +)  { 

for  (i  =  0  ;  i  <  number Jnputs  ;  i+  +) 

map[r][c][i]  +  =  gain  *  (input[i)  -  map[r][c)[i))  ; 

> 

} 

> 

readjword  (pointer) 

int  pointer ; 

{ 

int  flag,  r,  c,  i,  j,  k  ; 

double  in[16],  dl,  d2,  d3,  d4,  d5  ; 
float  element ; 

int  Ioc2[2000](2],  Ioc3[2000][2]  ; 

FILE  *fsnd ; 

int  sound,  point,  x{5],  y[5]  ; 

int  max_pts ; 

double  max ; 

for  (i  =  0  ;  i  <  numberjnputs  ;  i  +  +) 
input[i]  =  0.0  ; 

fsnd  =  (open  (word_number(pointer],  "r")  ; 
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sound  =  0 ; 
i  =  0; 
flag  =  0 ; 
white  (flag  I  =  1)  { 

fscanf  (land,  "%f\  &  element) ; 
if  (feof(f*nd)  !=0) 
flag  =  i ; 
eto#  if  (i  >  SB) 

flag  =  1 ; 

etae  { 

in{i]  =  (double)  element ; 
i++  ; 

> 

if  ((i  =  =  15)  A&  (flag  =  =  0))  { 

f  mindiat  (f  map,  in,  &loc2[sound][0]) ; 
i  =  0 ; 
sound+  +  ; 

> 

> 

fclose  (fsnd)  ; 

for  (i  =  0  ,  i  <  sound  ;  i+  +)  { 

Ioc3[i][0]  =  Ioc2[i][0]  ; 
k>c3li][1]  =  loc2[i][1]  ; 

> 

...  Trajectory  Reduction ... 

for  (i  =  0  ;  i  <  j ;  i++)  { 

point  =  Ioc2[i][0]  +  loc2[i][1]  *  f_xsize  ; 
input(i]  =  point  /  225.0  ; 

> 


f_mindiat  (f  map,  inp,  close) 


double 

inp[l6]  ; 

irrt 

closed]  ; 

float 

f_map[20]  [20]  ( 1 6]  ; 

irrt 

r,  c,  i ; 

double 

dist ; 

double 

minimum  =  99999.9 

for  (r  =  0 

;  r  <  f_ysize  ;  r++)  ( 

for  (c  =  0  ,  c  <  fjtsize  ;  c+  +)  { 
dist  =  6.0 ; 

for  (i  =  0  ;  i  <  f_number_inputs  ;  i+  +) 

dist  +=  pow  (inp(i]  •  f_map|r][c][i],  2.C) ; 
if  (dist  <  minimum)  { 

minimum  =  dist ; 
c!ose[0]  =  c ; 
close[lj  =  r ; 

> 

} 
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$  link  twobaa2,nweight10, options  tile/opt 
/* 

**••*•»•••••••••*••***••«**•*»*•» twobaa2.c  **•******•****••**•**•»•< 

Routine  to  train  a  second  Kohonen  net  to  process  reduced  75 
point  trajectories  from  first  kohonen  net.  The  points  are  scalars 
from  0  to  224.  Short  trajectories  are  filled  wih  trailing  0‘s. 

Initial  weights  are  randomly  distorted  from  the  first  run  of 
inputs.  Updates  to  weights  use  trajectories  precalculated  and 
stored  in  peth.dat  file. 

This  version  adds  ‘conscience'  to  choosing  closest  node;  i.e.  M 
node  is  chosen  too  often  it  is  not  considered  for  closest  status. 


Capt  Gary  Barmors,  10  Aug  88 


include  math 

include  stdio 

include  time 

int 

conscience[20][20]  ;/*  records  #  times  closest  •/ 

int 

nodes ;  /*  number 

double 

consc  =  1.1  ;  /*  conscience  factor 

float 

map[20][20](225] ;  /*  output  nodes  */ 

double 

input[22S]  ;  /*  input  nodes  */ 

double 

gain,  noise ; 

double 

mcount ; 

double 

percent ; 

int 

dosest[2]  ;  /*  closest  node  */ 

int 

neigh[2]  ,  /*  neighbor  */ 

int 

nrangex,  nrangey  ;  /*  neighbor  range  */ 

int 

nfactorx,  nfactory  ;  /*  neighbor  factor  */ 

Ion 

gcount ;  /*  #  of  iterations  */ 

int 

graph  ;  /*  #  between  plots  */ 

int 

seed  ; 

int 

maxneighx.  maxneighy  ;  /*  Starting  area  *1 

int 

minneighx,  minneighy  ;  /*  Final  area  V 

int 

xsize,  yaize  ;  /*  Size  of  array  */ 

int 

number Jnputs ; 

char 

training_file(30],  net_file(30],  first_net_file[30]  ; 

char 

temp_file[15]  ; 

char 

net_name[15] ; 

struct  curve  { 

int 

type ; 

double 

maxgain 

double 

mingain 

double 

midgain 

int 

midtime 

}  gcurve ; 

struct  fig  { 
int 

>  »*8  ; 


rnd  in  ; 


J 
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Mt  (mop) 

float  mep(20]  (20]  [225]  ; 

{ 

int  r,  c,  i ; 

float  mexj-end  =  pow(2.0, 31.0)  - 1.0 ; 


> 


nodee  =  ysize  *  xsize  ; 
for  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

for  (c  =  0 ;  c  <  xsize  ;  c+  +)  { 
conecience[r][c]  =  0 ; 
getin  0  ; 

for  (i  =  0  ;  i  <  number jnputa  ;  i++)  { 
mekp[r]{c][i]  =  input[i]  + 

rand  0  /  max  rand  ; 

> 

> 

> 


mindist  (map,  inp,  close,  its) 


double 

inp[225]  ; 

int 

close [2]  ; 

float 

map  [20]  [20]  [22S]  ; 

long 

its ; 

int 

r.  c,  i ; 

double 

dist ; 

double 

minimum  -  9.99e31 

for  (r  ==  0  ; 

r  <  ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  xsize  ;  c+  +)  { 
diet  =  0.0  ; 

if  (conscience^]  [c]  <  consc  *  its  /  nodes )  ( 
for  (i  =  0  ;  i  <  number Jnputs  ;  i  +  +  ) 

diet  +=  pow(inp[i]  -  map[rj[c][i],  2.0); 
if  (dist  <  minimum)  { 

minimum  =  dist  ; 
closefO]  =  c ; 
close[lj  =  r ; 

> 

> 

} 

> 

conscience[close[1]][close[0]]  +  =  1  ; 

} 


userinp  0 

{ 

int  line ; 

int  c ; 

struct  tm  ‘localtimeO.  *time  ; 

int  *bintim ; 

do  { 

printf  (“TWO  KOHonen  net  training  (output  only)...  \n\n")  ; 

printfC'Enter  size 'm  n'  (for  an  m  x  n)  of  array  =  ?  [int  int)  ") ; 
scanf(“%d  %d“,  &ysize,  &xsize)  ; 
if  (ysize  <  2) 

ysize  =  2  ; 


twobaa2 
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eta*  if  (ysiz*  >  20) 

yaiz*  =  20 ; 
if  (xsize  <  2) 

xsize  =  2 ; 
ets#  if  (xsize  >  20) 

xsize  =  20 ; 


printf  (“Do  you  want  0)  sequential  training, Vn") ; 
printf  ("  1)  randomized  training?  ") , 
scant  (“%d",  &fteg.md_in) ; 

printf  (“Enter  name  of  header  file  containing  words  (less  hdr): ") ; 

scant  (“%*",  temp_file) ; 

sprintf  (training_fite,  "%*.hdr”,  tempjile) ; 

number Jnputs  =  75 ; 

printf  ("Enter  name  of  pre-processor  Kohonen  net  file  [less  net}:  ") ; 

scant  (“%s",  net_name) ; 

sprintf  (first  net  fiie.  “%*.net",  net_name) ; 

printf(“Enter  name  of  net  file  to  create  [less  net]:  ") ; 

scant  (“%s“,  net_name) ; 

sprintf  (net_file,  “%a.n*t",  net_name)  ; 

printf  ("Number  of  iterations  =  ?  [int]  ")  ; 
scant  (“%td”,  &count)  ; 
if  (count  <  =  10  1 1  count  >  130000) 
count  =  100 ; 
mcount  =  (double)  count ; 

printf  ("Number  of  iterations  between  status  messages  =  ?  [int]  ")  ; 
scant  (“%d",  &graph)  ; 
if  (graph  <  1  1 1  graph  >  count) 
graph  =  10 ; 


ingain  0  ; 

printf  ("Starting  size  of  neighborhoods  “yn  xn'  =  ?  [int  int]  ") , 
scanf  ("%d  %d",  &maxneighy,  &maxneighx)  ; 
if  (maxneighx  <  2  1 1  maxneighx  >  xsize  •  1) 
maxneighx  =  2 ; 

if  (maxneighy  <  2  1 1  maxneighy  >  ysize  - 1) 
maxneighy  =  2 ; 

printf  ("Final  size  of  neighborhoods  'yn  xn'  =  ?  [int  int]  ") ; 
scanf  ("%d  %d",  &minneighy,  iminneighx) ; 
if  (minneighx  <  1  1 1  minneighx  >  maxneighx) 
minneighx  =  1  ; 

if  (minneighy  <  1  1 1  minneighy  >  maxneighy) 
minneighy  =  1  ; 

printf 

(“Initial  seed  for  random  #  generator  =  ?  [int]  "); 
scanf  (“%d”,  &seed)  ; 
if  (seed  =  =  0)  { 

seed  =  138 ; 

} 

srand  (seed)  : 

printf("Ready  to  begin?  (y/n)  ")  ; 
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twobaa2 


> 

ingain  0 

{ 

int 


white  ((c  =  gate  (stdin))  =  =  ' '  1 1  c  =  =  \n'  1 1  c  =  =  V) 
}  white  (c !  =  V1) : 


lina ; 


printf("For  gain  enter  0)  LINEAR,  1)  SIGMOIDAL  2)  PIECEWISE  UNEAR  :  "); 
scant  ("%d",  &gcurve.type) ; 


if  (gcurve.type  =  =  0  1 1  gcurve.type  ==  1)  { 
printf  ("Maximum  gain  =  ?  (float]  ")  ; 
scant  ('%£",  &gcurve  maxgain)  ; 
if  (gcurve.maxgain  >  =  1.0  |  j  gcurve.  maxgain  <  =  0.0) 
gcurve.  maxgain  =  99 ; 
printf  ("Minimum  gain  =  ?  [float]  ") ; 
scant  (“%E”,  Agcurvemingain)  ; 
if  (gcurve. mingain  <  =  0.0  J  |  gcurve. mingain  >  =  1.0) 
gcurve.mingain  =  0.0 ; 

} 

else  { 

printf  ("First  segment  starting  gain  =  ?  [float]  ”) ; 
scant  (“%£”,  Agcurve.  maxgain) ; 
it  (gcurve.maxgain  >=  1.0  1 1  gcurve.maxgain  <  =  0.0) 
gcurve.maxgain  =  ,9S  , 

printf  ("Second  segment  starting  gain  =  ?  [float]  ")  ; 
scant  ('“%£",  &gcurve.  midgain)  ; 
if  (gcurve.midgain  <  =  0.0  1 1  gcurve.midgain  >  =  1.0) 
gcurve. midgain  =  0.0  ; 

printf  ("Second  segment  starting  iteration  =  ?  [float]  ”)  ; 
scant  ("%d",  Agcurve. midtime)  ; 
if  (gcurve.midtime  <  =  0  1 1  gcurve  midtime  >  count) 
gcurve.  midtime  -  count  /  2  ; 

gcurve.mingain  =  0.0 ; 

} 


getgain  (i) 

long  i ; 

{ 

if  (gcurve.type  =  =  0) 

gain  =  (percent  *  (gcurve.maxgain  ■  gcurve.mingain))  + 
gcurve.mingain ; 
else  if  (gcurve.type  =  =  1) 

gain  =  0.9  *  (gcurve.maxgain  -  gcurve.mingain)  /  (1.0  +  exp  (i  • 
count/ 2.0))  +  .1  ; 

else  { 

if  (i  <  gcurve.midtime) 

gain  =  gcurve.maxgain  *  (1 .0  -  (double)  i  /  gcurve.midtime)  ; 

else 

gain  =  gcurve.midgain  *  (1 .0  -  (double)  i  /  count) ; 

> 

> 


save_net  0 
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{ 

int  r,  c,  I ; 

FILE  *fnet ; 

fnet  =  fopen(net_file,"w") ; 

fprintf  (fn*t,"%d  %d  %d",  yaize,  xstze,  numberjnputs) ; 
for  (r  =  0  ;  r  <  yaize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  xsiza ;  c+  +)  { 

for  0  =  0 ;  i  <  number  input*  ;  i+  +)  { 

fprintf  (fnet,"' %f',  map[r][c][i]) ; 

> 

> 

> 

fckw*  (fnet) ; 


mainO 

{ 

long 

char 

int 

int 

FILE 


i ; 

Si [10]  , 
ws_id  =  1  ; 
clear  flag  *  1; 
*tf : 

_stklen  ; 


extern  unsigned 


_stklen  =  8192  ; 

userinp  0  ;  /*  Get  input  values  */ 
nfactorx  =  maxneighx  -  minneighx  +  1  ; 
nfactory  =  maxneighy  -  minneighy  +  1  ; 
init  (map)  ,  /*  initialize  weights  V 
readjmjile  0  ; 


for  (i  =  1  ;  i  <  =  count ;  i+ +)  { 
if  (i  %  graph  =  =  0)  { 

printf  ("7WOKOH7  gain  =  %f,  yrange  =  %d,  ", 
gain,  nrangey)  ; 

printf  (“xrange  =  %d,  iteration  #  %d",  nrangex.i)  ; 
printf  ("  (of  %ld)\n",  count)  ; 
if  (access  (net_file,0)  =  =  0) 
delete  (net_file)  ; 
save  net  0  ; 

> 

percent  =  (mcount  -  0  /  mcount ; 
getgain  (i) , 
if  (flag.rndjn  =  =  0) 
getin  0  ; 

else 

get_rnd_in  0  ; 

mindist  (map,  input,  closest,  i)  ; 
if  (gcurve.type  !  =  2)  { 

nrangex  =  minneighx  +  percent  *  nfactorx  ; 
nrangey  =  minneighy  +  percent  *  nfactory  ; 

else  if  (i  <  gcurve.  midtime)  { 

nrangex  =  minneighx  +  nfactorx  * 

((double)  (gcurve. midtime  -  i))  /  gcurve. midtime  ; 
nrangey  =  minneighy  +  nfactory  * 

((double)  (gcurve  midtime  -  i))  /  gcurve. midtim*  ; 

else  { 


twobaa2 
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> 

r 


*/ 


nrangex  =  minneighx ; 
nrangey  =  minneighy  ; 
} 

neigh[0]  =  nrangex ; 
neighjl]  =  nrangex ; 
weightem  (map) , 

} 

save_net  0 ; 

printf  ("\nNet  file:  %e  saved*', n",  netjile) ; 


■mtMnmwtMMMmt  nweightlO.c  •***********•*•»**•*•' 

These  routines  allow  training  and  tasting  of  a  second  Kohonen 
net  ot  two  net  system.  Inputs  are  75  point  trajectories  from  the 
first  net.  Points  on  the  trajectories  are  scalar  values  from  0  to 
224.  Short  trajectories  are  filled  with  trailing  O'e. 

This  version  uses  a  set  of  input  trajectories  saved  in  path.dat 
to  save  time  reading  *.trn  files  and  running  them  through  the 
first  trajectory  on  every  pass. 


#  include  math 

#  include  stdio 

#  include  stat 


double 

innput(l00][75]  J*  input  vectors  */ 

extern  double 

input[225] ;  /*  input  nodes  */ 

extern  double 

gain  ; 

extern  int 

closest[2]  ;  /*  closest  node  */ 

extern  int 

neigh[2]  ;  /*  neighbor  */ 

extern  int 

xsize,  ysize  ;  t*  Size  of  array  */ 

extern  int 

number Jnputs ; 

extern  char 

training_file(30]  ; 

extern  char 

first_net_file[30]  ; 

int 

number_discretes ; 

int 

word_counter ; 

int 

num_words ; 

char 

word_number(100](15]  ; 

int 

f_ysize,  f  xsize,  f  number  inputs  : 

float 

f_map(20][20](16] ; 

read  trn  file  0 

{ 

FILE  *tf,  *fnet ; 

int  j,  i,  r,  c  ; 

tf  =  fopen  (training_file,  "r")  ; 

(scant  (tf,  "%d",  4num_words)  ; 
for  (i  =  0  ;  i  <  num_ words  ;  i+  +) 

(scant  (tf,  "%8 ",  word_number[i])  , 
(close  (tf) ; 


fnet  =  fopen  (firsi_net_file,  "r") ; 

fscartf  (fnet,"%d  %d  %d",  4f_ysize,  4f_xsize,  4f_number_inputs)  ; 
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for  (r  =  0  ;  r  <  f_ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  fjtsize  ;  C++)  { 

for  (i  =  0  ;  i  <  f_numberjnput»  ;  i+  +)  { 

fseanf  (fnet,"  %f if  mep[r][c][i]) ; 

> 

} 

> 

fcloee  (fnot)  ; 

fnet  =  fopon  ("path.rtet",  “r") ; 
fseanf  (fnol,  “%d”,  inum_worda) ; 
for  (i  *  o  ;  i  <  num_words  ;  i+  +)  { 

for  (j  =  0  ;  j  <  number Jnputa  ;  j+  +) 

fseanf  {fnet,  “%le",  iinnput[i][j])  ; 

> 

fcloee  (fnet)  ; 
word  counter  =  0  ; 

} 

getin  0 

{ 

int  j ; 

if  (word_counter  =  =  numwords) 
word  counter  =  0  ; 
for  (j  =  0  ;  j  <  number jnputs  ;  j+  +) 

input(j]  =  innput[word_counter][jj  , 
word  counter  +  +  ; 

} 

get_md  in  0 
{  " 

int  i,  j ; 

double  max_rand  =  pow  (2.0,  31 .0)  *1.0; 

irrt  pointer , 

pointer  =  floor  ((randO  *  (num_words  -  .0001)  /  max_rand))  ; 
for  (j  =  0  ;  j  <  number  Jnputa  ;  j  +  +) 

input[j]  =  innputfword  counter]  [j]  ; 

> 

weightem  (map) 

float  map[20]  [20]  [225]  ; 

{ 

int  nright,  nleft,  nup,  ndown,  r  ,  c,  • ; 

if  (neigh [0]  >  0  ii  neigh[1]  >  0)  { 

nright  =  closest[0j  +  neigh[0]  -  1  ; 
if  (nright  >  =  xsi2e) 

nright  =  xsize  - 1  ; 
nleft  =  closest[0]  -  neigh(0J  +  1  ; 
if  (nleft  <  0) 

nleft  =  0 ; 

nup  =  closest!  1]  -  neigh[1]  +  1  ; 
if  (nup  <  0) 

nup  =  0 ; 

ndown  =  closest  [1]  +  neigh(l]  •  1  ; 
if  (ndown  >  =  ysize) 

ndown  =  ysize  •  1  ; 

y 
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eiee  { 

might  =  doaest[0] ; 
nlett  =  cloeeet[0] ; 
nup  =  ck>s**t[l] ; 
ndown  =  cloeeet[1] ; 

> 

for  (r  =  nup;  r  <  =  ndown  ;  r+  +)  { 

for  (c  =  nleff ;  c  <  =  nright ;  c+  +)  { 

for  (i  =  0  ,  i  <  number Jnputa  ;  i++) 

map[r][e](G  +=  gain  *  (input[i]  •  map[r][c][i])  ; 

} 

> 


re«d_word  (pointer) 

int  pointer ; 

{ 

int  flag,  r,  c,  i,  j,  k  ; 

double  in[16],  dl .  d2,  d3,  d4,  d5  ; 
float  element ; 

int  Ioc2[2000][2],  Ioc3[2000][2]  , 

FILE  *fend ; 

int  sound,  point,  x(5),  y[5]  ; 

int  max_pts ; 

double  max ; 

for  (i  =  0  ;  i  <  number Jnputs  ;  i++) 
inputfi]  =  00 ; 

fend  =  (open  (word_number[pointer],  "r")  ; 

sound  =  0 ; 

i  =0; 

flag  =  0 ; 

while  (flag  1=  1)  { 

fecanf  (fend,  “%f",  &eiemertt)  , 
if  (feof(fend)  1=0) 
flag  =  1  ; 
else  if  (i  >  99) 

flag  =  1  ; 

else  { 

in(i]  =  (double)  element ; 
i++  ; 

> 

if  ((i  ==  15)  &&  (flag  =  =  0))  { 

f  mindist  (f  map,  in,  &loc2[sound][0])  ; 
i  =  0  ; 
sound ++  ; 

} 

> 

fclose  (fend)  ; 

for  (i  =  0  ,  i  <  sound  ;  i+  +)  { 

Ioc3[i][0]  =  Ioc2[i][0]  ; 
loc3[i][1]  =  loc2(i](1]  ; 

} 

max _pts  =  sound  ; 

...  Trajectory  Reduction  ... 

for  (i  =  0  ;  i  <  j ;  i++)  { 

point  =  Ioc2[i][0]  +  loc2(i][l)  *  f_xsize  ; 
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twobea2 


input[i]  =  point  /  225.0  ; 

} 


f jnindist  (f_map,  inp,  close) 


double 

inp[16]  ; 

int 

close(2] ; 

float 

f_map[20][20][l6] ; 

int 

r,  c,  i ; 

double 

dist ; 

double 

minimum  =  99999.9 

for  (r  =  0 ; 

r  <  f_ysize  ;  r++)  { 

for  (c  =  0  ;  c  <  f_xsize  ;  c+  +)  { 
diet  =  0.0 ; 

for  (i  =  0  ;  i  <  f_number_inputs 
dist  +  =  pow  (inp[i]  -  f 
if  (dist  <  minimum)  { 

minimum  =  dist ; 
close{0]  =  c ; 
close[11  =  r ; 

} 
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map{r][c][i],  2.0) ; 
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$  link  outdat,ntraj,option«  file/opt 

/* 

tHMMtmiMHMMnmMtHm  OUtdStC  ********************** 

Routines  to  create  a  path.dat  file  containing  75  point  scalar 
trajectories  from  the  first  Kohonen  net.  Each  scalar  is  from 
0  to  224.  Short  trajectories  are  filled  with  trailing  O'a. 

The  *.dat  file  is  used  to  train  a  net  quickly,  eliminating  file 
reading  and  running  data  through  the  first  net  repeatedly. 


V 


Capt  Gary  Barmore,  3  Aug  88 


#  include  math 

#  include  stdio 

#  include  time 


float  map[20][20][225j  ,  t*  output  nodes  V 
double  input[225] ;  /*  input  nodes  */ 
double  gain,  noise ; 

int  closest[2]  ;  /*  closest  node  */ 
int  xsize,  ysize  ;  /*  Size  of  array  V 
int  numberjnputs ; 

char  training_file[30],  net_file[30],  first_net_file[30J  ; 

char  temp_fiie[l5]  ; 

char  net_name[15] ; 

init  (map) 

float  map[20]  [20]  [225]  ; 

{ 

int  r,  c,  i ; 

FILE  *fnet ; 

fnet  =  fopen(net_file,'r")  ; 

fscanf  (fnet,"%d  %d  %d",  &ysize,  &xsize,  &number_inputs)  ; 
for  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  xsize  ;  c+  +)  { 

for  (i  =  0  ;  i  <  numberjnputs  ;•♦+){ 

fscanf  (fnet, "%f",  &map[r][c][i])  ; 

} 

> 

fclose  (fnet)  ; 

> 


mindist  (map,  inp,  close) 
double 
int 
float 

{ 

i  int 

double 

double 


inp[225]  ; 
c!ose(2]  ; 

map(20]  [20]  [225]  ; 

r,  c,  i ; 

dist ; 

minimum  =  999999.0 ; 


for  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  xsize  ;  c  +  +)  { 
dist  =  0.0 ; 

for  (i  =  0  ;  i  <  numberjnputs  ;  i  +  +  ) 
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out  del 


diet  +  =  pow  (inp[i]  -  map[r][c][i],  2.0) ; 
if  (diet  <  minimum)  { 

minimum  =  diet ; 
cioee[0]  =  c ; 
cloee(1]  =  r ; 

> 


userinp  0 

{ 

int  line ; 

int  c  ; 

struct  tm  *loc«ttim«0.  *time  ; 

int  *bintim ; 

do  { 

printf  ("OUTQAT:  Create  peth.dat  for  net  training  ...  \n\n")  ; 

printf  (“Enter  name  of  header  file  containing  words  (less  hdr):  ")  ; 

scant  tempjile)  ; 

sprintf  (trainingjile,  "%e.hdr",  tempjile)  ; 

numberinputs  =  75 ; 

printf  ("Enter  name  of  pre-processor  Kohonen  net  file  [lees  net]:  ")  ; 

scant  r%s",  netname)  ; 

sprintf  (fir8t_net_file,  “%e.net",  net_name)  ; 

printf  ("Enter  name  of  data  file  to  create  [less  del]:  ”) ; 

scant  ("%s",  net_name)  ; 

sprintf  (net  file.  “%s.dat",  net_name)  ; 

printf("Ready  to  taegin?  (y/n)  ") , 

while  ((c  =  gate  (stdin))  =  =  "  1 1  c  =  =  V  1 1  c  =  =  M’) 


> 


}  while  (c  !=  ‘y’)  : 


save  net  0 

{ 

int  r,  c,  i ; 

FILE  *fnet ; 

fnet  =  fopen(net_file,"w")  ; 

fprintf  (fnet,"%d  %d  %d ",  ysize,  xsize,  numberjnputs)  ; 
for  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  xsize  ;  c+  +)  { 

for  (i  =  0  ;  i  <  numberjnputs  ;  i  +  +)  { 

fprintf  (fnet,"  %f",  map[r][c][i])  ; 

} 

> 

} 

fcloee  (fnet)  ; 

> 

mainQ 

{ 

long  i ; 


i 


4 


% 


* 


« 


« 
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out  dot 


I 


> 


} 


char 

int 

irrt 

FILE 

extern  unsigned 


81(10] ; 
wsjd  =  1  ; 
clear  flag  =  1; 
*tf ;  “ 

_stklen ; 


_stklen  =  8192 ; 

userinp  0  i  /*  Get  input  values  */ 
inrt  (map) ;  r  Initialize  weights  */ 
reed jtm JHe  0 ; 


printf  ("\nNet  file:  %a  saved!\n",  netjile) ; 


Routines  to  save  75  point  scalar  trajectoires  from  the  first 
Kohonen  net  to  save  time  in  training  the  second  Kohonen.  Each 
scalar  is  from  0  to  224.  Short  trajectories  are  filled  with 
trailing  0's. 


#  include  math 

#  include  stdio 

#  include  stat 


double 

innput[100]I75]  J*  input  vectors  • / 

extern  double 

input[225] ;  /*  input  nodes  V 

extern  double 

gain  ; 

extern  int 

closest[2] ;  /*  closest  node  */ 

extern  int 

neigh[2]  ;  /*  neighbor  •/ 

extern  int 

xsize,  ysize  ;  /*  Size  of  array  •/ 

extern  int 

number Jnputs  ; 

extern  char 

training_file[30]  ; 

extern  char 

first_net_file(30]  ; 

extern  char 

net_file[30]  ; 

int 

number_discretes  ; 

int 

word_counter ; 

int 

num_words ; 

char 

word_number[  1 00]  [  1 5)  ; 

int 

f_ysize,  f  xsize,  f  number  inputs  ; 

float 

f_map{20](20](16]  ; 

read  trn  file  0 

{ 

FILE  *tf,  *fnet ; 

int  j,  i,  r,  c  ; 

►  tf  =  fopen  (trainingjile,  "r")  ; 

f scant  (tf,  “%d",  &num_words)  ; 
for  (i  =  0  ,  i  <  num_worda  ;  i  +  +) 

fscanf  (tf,  "%e",  word_number[i])  ; 
fclose  (tf)  ; 


> 


fnet  =  fopen  (first_net_file,  "r")  ; 

fscanf  (fnet,"%d  %d  %d",  &f_ysize,  &f_xsize,  &f_number_inputs)  ; 
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tor  (r  =  0 ;  r  <  f_ysize ;  r+  +)  { 

♦or  (c  =  0  ;  c  <  f jcaize  ;  c+  +)  { 

for  (I  =  0 ;  i  <  f_numberjnputs  ;  i+  +)  { 

fscanT (fnet,"  %f",  &♦  map[r](c][i]) 

> 

> 

> 

♦close  (fnet) ; 

♦not  =  fopon  (netjile,  “w") ; 
fpnrttf  (fnet,  “%d\n”,  num_words) ; 

♦or  (I  =  0  ;  i  <  num_words  ;  i+  +)  { 
readword  (i) ; 

♦or  (j  =  0 ;  j  <  numborjnput# ;  j+  +)  { 
innputlHlj]  =  input  [j] ; 
tprintt  (♦not,  “%la\n",  input[j])  ; 

} 

} 

fcloeo  ((not)  ; 

> 

gotin  0 

{ 

int  j ; 

it  (word_countor  =  =  num  jwords) 
word  countor  =  0 ; 

♦or  (j  =  0  ;  j  <  number Jnputs  ;  j+  +) 

input  [j]  -  innput[word_counter](j]  ; 
word  countor++  ; 

} 

got  rndjn  0 
{  " 

int  i,  j ; 

double  max  rand  =  pow  (2.0,  31 .0)  -1.0; 

int  pointer ; 

pointer  =  floor  ((randO  *  (num_words  -  0001)  /  max  rand))  ; 
♦or  (j  =  0  ;  j  <  numberjnputa  ;)■*-+) 

input[j]  =  innput[word  counter]  [j] ; 

} 

weightem  (map) 

float  map[20]  [201(225]  , 

{ 

int  nright,  nleft,  nup,  ndown,  r ,  c,  i ; 

if  (neigh[0]  >  0  &&  neigh(1]  >  0)  { 

nright  =  closest[0]  +  neigh[0]  - 1  ; 
it  (nright  >  =  xsize) 

nright  =  xsize  - 1  ; 
nleft  =  ctosest[0]  -  neigh[0]  +  1  ; 
it  (nleft  <  0) 

nleft  =  0  ; 

nup  =  closost[1]  -  neigh[1]  +  1  ; 
if  (nup  <  0) 

nup  =  0 ; 

ndown  =  closest [1]  +  neigh[1]  - 1  ; 
if  (ndown  >  =  ysize) 
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out  da* 


ndown  =  ytize  - 1  ; 

> 

etee  { 

n  rig  tit  =  clo*eet(0] ; 
nleft  =  cloeestfO] ; 
nup  =  cloeeet[1] ; 
ndown  =  clo*eet[1] ; 

> 

for  (r  =  nup;  r  <  =  ndown  ;  r+  +)  { 

for  (c  =  nleft ;  c  <  =  might ;  c+ +)  { 

for  (I  =  0  ;  i  <  number Jnputs  ;  i++) 

m*PM[c]li]  +  =  gain  *  (input[i]  -  map[rj(cj[i]) ; 

> 

> 


reed_word  (pointer) 


int 

pointer ; 

int 

flag,  r,  c,  i.  j,  k  ; 

double 

in[16),  dl,  d2,  d3,  d4,  d5  , 

float 

element ; 

int 

Ioc2(2000](2],  Ioc3[2000](2) 

FILE 

•tend ; 

int 

sound,  point,  x[5],  y[5]  ; 

int 

max  pts ; 

doubla 

max ; 

for  (i  =  0 ;  i 

i  <  number  Jnputs  ;  i++) 

input[i]  =  0.0 ; 

tend  =  fopen  (word_number[pointer],  “r") ; 

sound  =  0 ; 

i  =  0; 

flag  =  0 ; 

while  (flag  !=  1)  { 

fecanf  (fend,  "%f",  ^element)  ; 
if  (feof(fend) !  =0) 
flag  =  1  ; 
else  if  (i  >  99) 

flag  =  1  ; 

else  { 

infij  =  (double)  element ; 
i+  +  ; 

} 

if  ((i  =  =  15)  &&  (flag  =  =  0))  { 

f_mindist  (f_map,  in,  &loc2[sound][01)  ; 

f=  0  ; 

sound  ++  ; 

} 

} 

fclose  (tend)  ; 

for  (i  =  0  ;  i  <  sound  ;  i+  +)  { 

Ioc3[i][0]  =  Ioc2[i][0]  ; 
loc3[i)[1]  =  loc2(i][1]  ; 

} 

max_pt8  =  sound ; 

...  Trajectory  Reduction  ... 


B-76 


Appendix  8:  Computer  Programs 


outdet 


for  (I  =  0 ;  i  <  j ;  i+  +)  { 

point  =  loc2[i][0J  +  loc2[i][1]  *  fjeeize  ; 
input[i]  =  point  /  225.0  ; 

> 


f  mindwt  (f_m«p,  inp,  close) 


double 

inp[l6] ; 

int 

cioae[2]  ; 

float 

f_mep[20](20][16]  ; 

int 

r,  c,  i ; 

double 

diet ; 

double 

minimum  =  99999.9 

for  (r  =  0 ;  r  < 

f_yeize ;  r++)  { 

for  (c  =  0  ;  c  <  f_x8ize ;  c  +  +)  { 
diet  =  0.0 ; 

tor  (i  =  0  ;  i  <  f_number_inpute  ;  i++) 

diet  -*-  =  pow  (inp[i]  -  f_map[r)[c)[i],  2.0) ; 
if  (diet  <  minimum)  { 

minimum  =  diet ; 
close[0]  =  c  ; 
cloaeilj  =  r ; 

} 
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twopk* 


$  link  twopic4,npiot,npnnter,mat3b,nw*igbtB,option8jile/opt 


r 


•*••«•*•****•*•*••***•*•*•*••*•** 


twoptcA.c 


Routine  to  sh ow  locations  of  word*  on  second  Kohonen  net.  The 
final  version  aasume*  a  test  set  of  100  words.  10  each  of  zeros, 

ones . nine*  (respectively).  The  graph  identifies  the  test 

digit  which  lit  it  up. 

First  Kohonen  trajectories  are  compared  by  Euclidean  distance 
algorithm.  Trajectories  are  75  scalar  points  long. 

The  routine  was  written  to  test  what  node*  the  training  set  will 
light  up.  Basically,  this  allows  on*  to  determine  the  way  the 
training  spread  the  inputs  and  the  differentiability.  It  ia  net 
a  teat  of  the  net. 

••••♦ft****************************************************** 


include  math 

include  stdio 

include  time 

float 

map [20]  [20]  [225]  ;  /*  output  nodes  */ 

double 

input[225] ;  r  input  nodes  */ 

double 

gain,  noise ; 

double 

mcount ; 

double 

percent ; 

double 

xoff  =  0.0 ; 

double 

yoff  =  0.0 ; 

double 

nod*_dist ; 

int 

closest[2]  ;  /*  closest  node  */ 

int 

neigh[2] ;  /*  neighbor  •/ 

int 

nrangex,  nrangey  ;  f*  neighbor  range  */ 

int 

nfactorx,  ntactory  ;  /•  neighbor  factor  */ 

long 

count ;  /*  #  of  iterations  */ 

int 

graph  ;  /*  #  between  plots  */ 

int 

seed  ; 

int 

maxneighx,  maxneighy  ;  /*  Starting  area  */ 

int 

minneighx,  minneighy  ;  /*  Final  area  *1 

int 

xsize,  ysize  ;  /*  Size  of  array  *1 

int 

numberjnputs  ; 

int 

wrapjlag  =  0  ; 

int 

trainjlag,  train_discrete ; 

char 

training_file(30],  temp_file[30],  first_net_file[30] 

char 

net_file(30]  ; 

struct  curve  { 

int 

type; 

double 

maxgain  ; 

double 

mingain  ; 

double 

midgain  ; 

int 

midtime ; 

>  gcurve 

extern  int 

xyQ  ;  /*  array  holding 

extern  double 

xdel,  ydel ; 

extern  double 

xlow,  xup,  ylow,  yup  ; 

extern  int 

num_worda ; 
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twoptc4 


extern  char 

mindiet  (map,  inp,  cioee) 
double 
int 
float 

{ 

int 

double 

double 


word_number(100][15] ; 


inp[225]  ; 
close [2] ; 

mop  [20]  [20]  [225] ; 

r,  c,  i ; 

diet ; 

minimum  =  9.99e31  ; 


> 


for  (r  =  0  ;  r  <  yet ze  ,  r+  +)  { 

for  (c  =  0  ;  c  <  xsize  ;  c+ +)  { 
diet  =  0.0 ; 

for  (i  =  0 ;  i  <  numberjnputa  ;  i+  +) 

dist  +  =  pow  (inp[i]  -  map[r][c][i],  2.0)  ; 
if  (dist  <  minimum)  { 

minimum  =  dist ; 
close[0]  =  c ; 
closejlj  =  r ; 

} 

> 

> 

node_dist  =  minimum  ; 


main  0 

{ 

int  c ; 


} 


printf  ("\nTWOPIC4  (Plot  Words  for  0/1  Reduced  Queued  Traj)...\n") ; 
map  speech  0  ; 


map  speech  0 

{ 

int  r.  c,  i,  j,  k  ; 

char  subjitle[60],  temp{30] ; 

char  name  tr][20]  ; 

int  loc[125][2j ; 

FILE  *fnet,  *flog ; 

int  sound ; 

short  length ; 


printf  ("\nEnter  name  of  pre-processor  Koh  net-file  [less  .net]:  ”) ; 

scant  ("%s",  temp)  ; 

sprintf  (first_net_file,  "%s.net  ”,  temp)  ; 

printf  ("Enter  name  of  header  file  containing  words  (less  .hdr):  ")  ; 

scant  ("%s",  temp_file) ; 

sphntf  (training_file,  "%s.hdr",  temp_file) ; 

printf  ('"Enter  name  of  output  Koh  netjile  (less  net],  ")  ; 

scant  ("%s",  temp_fiie) ; 

sprintf  (netjile,  "%s.net",  tempjile) ; 

road  trn_tile  0  ; 

fnet  =  fopen  (netjile,  "x")  ; 

fscanf  (fnet,  "%d  %d  %d",  &ysize,  &xsize,  &number_inputs) ; 


I 


J 


% 


■I 
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ter  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

tor  (c  =  0 ;  c  <  xsize ;  C++)  { 

for  (I  =  0 ;  I  <  number Jnputs  ;  i++)  { 

fscsnf  (Inst,"  %f &map[r](c][i])  ; 

} 

} 

> 

fcloee  (test) ; 

sprintf  (subjitle,  "%s  •>  %e  ->  %e", 

triningjile,  firat_net_file,  net_file) ; 
sprintf  (name_trj,  “%e.trj",  temp) ; 

flog  =  (open  (“temp.log", "w") ; 
fprintf  (flog,  “TWOPIC4:  %s",  namajrj)  ; 

graph  Jest  (trainingjile) ; 
length  =  (short)  strlen  (subjitle) ; 
draw_gnd2  (ysize,  xsize,  subjitle,  length) ; 

printf  ("\nExpect  %d  calculationsAn",  num_words)  ; 
for  (sound  =  0  ;  sound  <  num_words  ;  sound ++)  { 
getin  0  ; 

mindist  (map,  input,  &loc[aound][0]) ; 
printf  (“%d  :  (%d,%d]  dist  =  %le\n", 

sound,  loc[sound][0],  loc[sound][1],  node  dist) ; 
fprintf  (flog,  “%d  :  [%d,%d]  diet  =  %le\n", 

sound,  loc[8ound][0],  loc[sound][1),  node  dist)  ; 

} 

printf  (‘AnCalculations  finishedAn")  ; 
fcloee  (flog) ; 

draw  speech  map  (sound,  loc) ; 
scanf  (“%8",temp) ; 
clipoff  0  ; 
graphoff  Q  ; 


graph  Jest  (name) 

char  name[30] ; 

{ 

char  title(79J,  labelx[79J ; 

float  xloc[5]  =  {0,  639.0, 639.0,  0.0,  0.0}  , 
float  ytoc[5)  =  {349.0,  349.0,  0.0,  0.0,  349.0}  ; 
int  points  =  5  ; 

int  W8id  =  1  ; 

mt  clear_flag  =  1  ; 

short  length ; 


sprintf(title,"TWOPIC4:  Kohonen  TWO  NETS  --  %s",  name)  ; 
sprintf(labetx,"  ”)  ; 
graphon  Q  ; 

gkaSctearjas  (&ws_id,  &clear_flag) ; 
gksSpdyline  (&points,  xloc,  yloc)  ; 
prepcolmat  (ysize,  xsize) ; 
length  =  (short)  strlen  (title) ; 
outtitle  (title,  length)  ; 
length  =  (short)  strlen  (labelx) ; 
outlabetx  (labeix,  length) ; 
clipon  0  ; 
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twoptc4 


> 


Routine*  to  perform  graphics  for  net  output.  Note  that  the  last 
version  assumed  second  Kohonen  net  input  is  a  set  of  100  exemplars 
divided  into  10  even  classes  (10  sach).  Thus  th*  first  class  of 
tan  is  represented  as  0,  and  the  lest  as  9. 

*/ 

#  include  stdio 

#  include  math 

#  include  <gksdefs.h> 

#  include  <deacrip.h> 

#  define  BLACK0 

#  define  WHITE1 

float  ptsx[20][20]  [5],  ptsy[20][20][5]  ; 

float  px[20][20],  py(20H201 ; 

int  used  [20]  [20] ; 

int  colmat[20][20] ; 

int  pattem(16]  = 

{0,  -15,-15,  -12,-12,  -11,-11,  -1,-1,  -2,-2,  -4,-4,  -5,-5,  1}  , 


prepcolmat  (ysize,  xsize) 

irrt 

xsize  ; 

int 

ysize ; 

{ 

int 

r.  c.  xstart.  ystart ; 

int 

dx,  dy  ; 

dx  =  floor  (550.0  /  xsize)  ; 
dy  =  floor  (276.0  /  ysize)  ; 

xstart  =  280  -  dx  *  xsize  /  2  ; 
ystart  =  148  +  dy  *  ysize  /  2  ; 

for  (c  =  0  ;  c  <  xsize  ;  c+  +)  { 

for  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

ptsx[r][c][4]  =  (ptsx[r][c][3]  =  (ptsx[r][c][0]  = 
xstart  +  c  *  dx]) ; 

ptsx[r][c][2]  =  (ptsx[r][c][1]  =  ptsx[r][c][0]  +dx- 1)  ; 

ptsy[r][c][4]  =  (ptsy[r][c][1]  =  (ptsy[r][c][0J  = 
ystart  -  r  *  dy))  ; 

ptsy[r][c][3]  =  (ptsy[r][c]{2]  =  ptey[r][c][0]  -dy+  1)  ; 

px[r][c]  =  ptsx[r][c][0]  +  8.0  ; 
py[r][c]  =  ptsy[r][c][0]  -  8.0  ; 

> 

> 

for  (r  =  0  ;  r  <  20  ;  r+  +)  { 

for  (c  =  0  ;  c  <  20  ;  C++)  { 
used[r][c]  =  0 ; 

> 
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showem  0 

{ 

int  i ; 

float  rectx[16][6],  recty[16][6] ; 

int  points  =  5  ; 

for(i  =  1  ;  I  <  16  ;  i++)  { 

rectx[i][4]  =  (rectx(i][3)  =  (ractx[i][0]  =  173  +  16  *  i)) ; 
rectxliU2]  =  (rectxliHl)  =  (rectxli](0]  +  15)) ; 

recty[i][4]  =  (rectyfi][1]  =  (recty[i][0]  =  30)) ; 
recty[i](3]  =  (recty(ij(2]  =  23) ; 

setfilletyle  (pattern[i],  i) ; 

gksSfill  area  (&points,  &rectx[i][0],  &recty[i][0])  ; 

> 

> 

setfilletyle  (pattern,  pointer) 
int  pattern ; 

int  pointer ; 

{ 

int  style  =  3  ;  /*  hatch  */ 

int  color  [16]  =  {0,  7,7,  3.3,  5,5,  4,4,  4.  6,6,  2,2,  1}  ; 

if  (pattern  >  =  0)  { 

gksSset  filijnt  style  (&pattern)  ; 

> 

else  { 

flks$set_fill_style_index  (Apattem) , 
gksSset  fill_int_style  (&style)  ; 

> 

} 

draw  net  (number,  loc) 

int  number,  loc[64](2]  ; 

{ 

int  j,  i,  old_value  ; 

int  white  =  0  ; 

int  black  =  1  ; 

float  x,  y  ; 

char  8(4) ; 

$DESCRIPTOR(s_dsc,s)  ; 

for  (i  =  0  ;  i  <  number  ;  '++)  { 

x  =  ptsx(loc[i][1]][loc[i][0]][0]  +  4.0  ; 
y  =  ptsy[loc[i][1]][loc[ij(0]](0]  •  4  0  ; 
old_ value  =  used(loc(i][1]][loc(i]{0]]  /  10.0  ; 

gks$set_text_color_index  (&white) ; 

8printf  (s,"%3d",old_value)  ; 
gksStext  (&x,  &y,  &s_dsc)  ; 

j  =  i  / 10.0  ; 
sprintf  (s,"%3d  ",j)  ; 
gksSset _text_color_index  (iblack)  ; 
gksStext  (4x,  &y,  &s_dsc) ; 

if  ((i !  =  old_value)  &&  (old  value  !  =  0))  { 

y  -  =  6.0  ; 


twopic4 


( 
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eprintf  (s,"***'l ; 
gksStext  (&x,  &y,  &s  dac) ; 

> 

used(loc[i][1  ]]  [tec[i]  [0]]  =  i ; 

> 

> 

draw_ne*ghbors  (number,  loc) 

int  number.  loc[64][2] ; 

{ 

int  j,  i,  old_vaiue  ; 

int  white  =  0  ; 

int  black  =  1  ; 

float  x,  y ; 

char  s[4]  ; 

SDeSCRlPTOR(s_dsc,s)  ; 

for  (i  =  0 ;  i  <  1  ;  i++)  { 

x  =  ptsx[loc[i]  [1  ]]  [loc[i]  [0]] [0]  +  4.0  ; 
y  =  ptsy  [loc [i]  1 1  ] ]  {loc [i] (0]  J  [0]  -  4.0  ; 
oid_value  =  used[loc [i]  [1  ]]  [loc[i]  [0]]  / 10.0  ; 

gk8$set_text_color_index  (&white) ; 
sprintf  (s,"%3d",  old_value)  ; 
gksStext  (&x,  &y,  &s_dsc)  ; 

j  =  number  /  10.0  ; 
sprintf  (a,"%3d,\  j)  ; 
gks$set_text_color_index  (&black) , 
gksStext  (&x,  &y,  &s_dsc)  ; 

if  ((number  •  =  old  value)  &&  (old  value  I  =  0))  { 
y  •  =  6.0  ; 
sprintf  (8, "•**")  ; 
gksStext  (&x,  &y,  &s  dsc)  ; 

} 

used[loc[i](1]][loc[i](0]]  =  number ; 


rirawspeechmap  (number,  loc) 

int  number,  loc[125][2]  ; 

{ 

int  j.  i,  old_ value  ; 

int  white  =  0  ; 

int  black  =  1  ; 

float  x,  y,  xx[2],  yy(2]  ; 

int  points  =  2  ; 

char  s[4]  ; 

SOeSCRIPTOR(s_dsc,s)  ; 

for  (i  =  0  ;  i  <  number  ,  i+  +)  { 

x  =  ptsx(loc(i][1]][loc(i][0]](0]  +  40  ; 
y  =  ptsy (loc(i][1  ]] (loc(i](0]]  [0]  -  4  0  ; 
old_value  =  used[loc[i][1])[loc[i][0]]  /  10.0  ; 

gksSs«t_text_coior_index  (Swhite) ; 
sprintf  (s,  '%3d",  old_value)  ; 
gksStext  (&x,  &y,  &s_dsc) ; 
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twoptcA 


« 


< 


c 


/* 

*/ 


} 


j  =  i  / 10.0  ; 

gks$eet  text  color  index  (&black)  ; 
sprintf  (*,"%3d"1  dT 
gksStext  (&x,  &y,  &s_dsc)  ; 

it  ((i !  =  otd  value)  &&  (old  value  !=  0))  { 
y  -=  6.0 ; 

spnntt  (a.''***")  ; 
gks$text  (&x,  &y,  &•  dec) ; 

> 

u®ed[toc[i][1]][toc[i][0)l  =  i ; 
if(i!=0){ 

xx[0]  =  px[loc{i-1][1]](locfi-11[OJ) ; 
xx[1]  =  px{loc[i][1]][loc(i][0]]  ; 
yy[0]  =  py(loc[i-l][l]](loc(i-l]{0]J ; 
yy[1]  =  py[loc[i][i]][loc[i][0]] ; 

gks$polyline  (&points,  xx,  yy)  ; 

> 

) 


draw_grid  (ysize,  xsize) 

int  xsize.  ysize  ; 

{ 

int  points  =  5  ; 

int  r,  c ; 


for  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

for(c  =  0;c<  xsize  ,  c  +  +)  { 

gksSpolyline  (&points,  &ptax[r][c)[0],  &ptsy[r)[c)[0]); 

> 


draw_spectra  (map.  ysize,  xsize) 
int  xsize,  ysize  : 

float  map[20J(20](16]  , 

{ 

int  points  =  2  ; 

float  x[2],  y[2]  ; 

int  r,  c,  i ; 


for  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  xsize  ;  c  +  +)  { 
y[0]  =  ptsy(rJ(c](3J  ; 
for  (i  =  0  ;  i  <  15  ;  i++)  { 

x[0]  =  ptsx[r][c][3]  +  2.0  +  (2.0  *  i)  ; 
x[1]  =  x[0]  ; 

y[1]  =  ytO]  +  16.0  *  map[r][cj[i]  ; 
gks$potyline  (8>points,  x,  y)  , 
x[0]  +=  1.0  ; 
x[lj  +=  1.0  ; 

gks$potyline  (&points,  x,  y)  ; 
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$  link  twomask,  options  file/opt 

r 

mHMtnmMnHtMnmMttM  tWOmaak.C  ••*******««•***»•*»«»•*** 

Routine  to  create  *.msk  file  from  *.net  file.  The  *.msk  file  is  an 
array  of  integers  (mask [20]  [20])  corresponding  to  the  nodes  of  a 
*  net  file.  Each  integer  is  the  number  of  weights  which  are  !  =  0. 

Since  weights  represent  scalar  trajectories  of  75  points,  short 
trajectories  are  filled  with  trailing  0's.  This  obviously  allows 
for  some  inaccuracy  in  determining  the  trajectory  length  since 
the  first  node  is  also  represented  as  a  0.  This  will  be  corrected 
in  later  versions. 


•I 

#  include  math 

#  include  stdio 

int  mask  [20]  [20]  ; 

float  map[20][20][225]  ;  /*  output  nodes  */ 

double  node_di8t ; 

int  xsize,  ysize  ;  /*  Size  of  array  V 

int  number Jnputs ; 

char  training_file[30],  temp_file[30],  first_net_file[30] ; 
char  net_file[30]  ; 

non  zero  (map) 

float  map[20]  [20]  [225]  ; 

{ 

int  r,  c,  i,  number  ; 

tor  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  xsize  ;  c+  +)  { 
number  =  0 ; 

for  (i  =  0  ;  i  <  numberjnputs  ;  i+  +)  { 
printf  ("%7.le  ",  map[r][c][i])  ; 
if  (map[r][c][i]  >  5  0e-4) 
number +  +  ; 

} 

printf  ("\n****  %d  ****\n",  number)  , 
mask[r][c]  =  number ; 

} 


main  0 

{ 

printf  ("\nTWOMASK  (Creates  net  mask\n\n)  ...  ")  ; 
find  mask  0  . 

} 

find  mask  0 

{ 

int  r,  c,  i ; 

FILE  *fnet , 


printf  ("Enter  name  of  output  Koh  netjile  [less  net]:  ")  ; 

scant  ("%s".  temp_file)  ; 

sprintf  (netjile,  “%s.net",  temp_file)  ; 

I  sprintf  (trainingjile,  "%s.msk",  tempjile)  , 
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twomask 


fnat  =  toper  (nat_fila,  “r”) ; 

facanf  (frvet,"%d  %d  %d",  4yai iza,  &xsiza,  &numberjnputs)  ; 
for  (r  =  0  ;  r  <  yaize ;  r++)  { 

for  (c  =  0  ;  c  <  xaiza  ;  c+  +)  { 

for  (i  =  0  ;  i  <  numbar_inputa  ;  i+  +)  { 

facanf  (fnet,"  %f.  &map(r][c][i])  ; 
> 

> 

} 

fcloee  (fnat)  ; 

non_zaro  (map) ; 

8ava_mask  0  ; 


save  mask  0 

{ 

FILE  Mmask ; 

irrt  r,  c  ; 

fmask  =  fopan  (training_fila,  “w")  ; 
for  (r  =  0  ;  r  <  ysiza  ;  r+  +)  { 

for  (c  =  0  ;  c  <  xsiza  ;  c+  +)  { 

fprintf  (fmask,  “%d  ",  mask[r](c]) ; 

> 

> 

fclosa  (fmask)  ; 

> 
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$  link  twopic6,nwin5, lookups, options  file/opt 

r 

MUMMmMMMtMHttMtnmt  tW0pic6.C  *•»**»**»****•*»**»***••*«**••*' 

This  routine  identifies  (w/o  graphics)  the  node  from  a  second  Kohonen 
net  which  is  closest  in  DTW  distance  to  each  of  the  digits  in  a 
specified  set 

In  the  original  version,  the  trajectory  inputs  were  75  points  long 
and  scalar  (1-225).  In  this  version,  the  trajectories  are  100 
points  long. 

The  DTW  routine  uses  maskQ  as  the  node  length  and  lengthQ  for  the 
input  length  (i.e.  number  of  trailing  points  not  0). 


V 

#  include  math 

#  include  stdio 

#  include  time 


float 

double 

double 


map[20][20][225]  ;  /*  output  nodes  */ 
input[225) ,  /*  input  nodes  */ 
node  diet ; 


int 

int 

char 

char 

extern  int 

int 

int 

float 

float 

extern  int 
extern  int 
extern  int 


mindist  (close) 
irrt 


xsize,  ysize  ;  /*  Size  of  array  */ 
numberjnputs  ; 

training_file{30],  tempjile(30],  first_net_file[30] ; 
net_fHe[30]  ; 

num_words ; 
mask  (20]  (20]  ; 
map2[20](20](100][2]  ; 
aa  =  0.75  ; 
bb  =  0.75  ; 
f_xsize,  f_ysize  ; 
length[200]  ; 
location(2000](2]  ; 


close(2] 


int 

double 

double 

double 

double 


r,  c,  i ; 
dist ; 

distance  , 

minimum  =  9.99e31 
Pi.  P2 ; 


for  (r  »  0  ;  r  <  ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  xsize  ;  c+  +)  { 

dtw  (&map2[r][c](0][0],  location,  mask[r)[cj, 
length  [0],  &dist)  ; 
if  (dist  <  minimum)  { 

minimum  =  dist , 
close(0]  =  c  ; 
closejl]  =  r ; 

} 


} 


} 


node  dist  =  minimum  ; 
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> 

mein  0 

{ 

int  c ; 


> 


printf  ("\nTWOPfC8  (DTW  Words  for  0/1  Reduced  Queued  Traj)...\n") ; 
mapspeech  0  ; 


map_speecfi  0 
{ 

im 

char 

char 

int 

FILE 

int 

short 


r,  c,  i,  j,  k  ; 

sub_title[60],  temp[30] ; 
name  trj[20]  ; 
loc[2J~; 

•fnet,  *flog,  *fmask ; 
sound  ; 
length  ; 


printf  ("\nEnter  name  of  pre-processor  Koh  net -file  [lees  net]:  ") ; 

scant  ("%a”,  temp)  ; 

spnntf  (first_net_file,  “%s.net",  temp)  : 

printf  ("Enter  name  of  header  file  containing  words  (less  hdr):  ”)  ; 

scant  ("%s",  temp_file) ; 

sprintf  (trainingjile,  "%a.hdr",  tempjile)  ; 


printf  (“Enter  name  of  output  Koh  netfile  [less  net]:  ") ; 

scant  ("%s",  temp_file) ; 

sprintf  (net_file,  "%s.net",  temp_file) ; 

sprintf  (temp,  “%e.msk",  temp_file)  ; 


fnet  =  fopen  (netjile,  "r")  ; 

fscanf  (fnet,"%d  %d  %d".  &ysize,  &xsize,  &numberjnputs)  ; 
for  (r  =  0  ;  r  <  ysize  ;  r++)  { 

for  (c  =  0  :  c  <  xsize  ;  c+  +)  { 

for  (i  =  0  ;  i  <  number Jnputs  ;  i+  +)  { 

fscanf  (fnet,"  %f",  &map[r][c][i])  , 

} 

} 

} 

fclose  (fnet)  ; 
read_tm_file  0  ; 
fmask  =  fopen  (temp,  “r")  ; 
for  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  xsize  ;  c  +  +)  { 

fscanf  (fmask, "%d",  &mask[r][c]) ; 

} 

} 

fclose  (fmask) : 


flog  =  fopen  ('1emp.log", "w")  ; 

fprintf  (flog,  “TWOPIC6:  %s\n",  namejrj)  ; 

fprirrtf  (flog,  "->  %s  ->  %s  ->\n",  first_net_file,  netjile)  ; 

fprintf  (flog,  "Size  is  %d  by  %d  nodes\n",  xsize,  ysize)  ; 

printf  ("\nExpect  %d  calculationsAn",  num_words)  ; 
fprintf  (flog,  "Expect  %d  calculationsAn",  num_words) , 
for  (sound  =  0  ;  sound  <  num_words  :  sound-*-  +)  { 
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twopice 


getin  0 ; 
mindiat  (loc) ; 

k  =  loc[0]  +  toc[1]  *  x*ize  ; 
print!  ("\n%d :  [%d,%d]  diet  =  %le  ”, 

sound,  k>c[0],  loc[l],  node_dlat) ; 
print  digit  (k) ; 

fprirrtf  (flog,  “\n%d  :  [%d.%d]  diet  =  %le  ", 
sound,  loc[0],  loc[l],  nods_dist) ; 
(print  digit  (k,  flog) ; 

> 

print!  ('YiCaiculations  finishedAn”)  ; 
f close  (flog) ; 


dtw  (template,  utterance,  t  length,  u  length,  ave  diet) 
int  template(200]  [2]  flitter  ance [200]  [2] ; 

int  tjength,  ujength  ; 

double  *ave  diet ; 

{ 

float  back_path(2][200] ; 

int  b_p[2][200]  ; 

int  r,  c  ; 

int  ptr,  b_ptr ; 

float  dl ,  d2,  d3,  diet ; 

diet  =  0.0  ; 
bptr  =  1  ; 
b_p(0][0]  =  1  ; 

for  (r  =  1  ;  r  <  tjength  ;  r+  +) 

b_p[0][r]  =  b_p[0](r-1]  +  1  ; 
for  (r  =  0  .  r  <  tjength  ;  r+  +)  { 

back_path[0][r]  =  (diet  +=  bb  *  ( 

abs(utterance(O](0]  -  template(r][0])  + 
abs(utterancejoj(lj  -  template[rj(1 }))) , 

} 

for  (c  =  1  ;  c  <  u  length  ;  c+  +)  { 
if  (b j3tr~  =  =0)  { 

b_ptr  =  1  ; 
ptr  =  0  ; 

} 

else  { 

b_ptr  =  0  ; 
ptr  =  1  ; 

} 

for  (r  =  0  ,  r  <  tjength  ;  r+  +)  { 

dist  =  abs(utterance[c](0]  ■  template[r][0))  + 
ab8(utterance[c](1]  -  template[rj[lj)  ; 
if  (r  ==  0)< 

back_path(ptr][r]  =  back  _path[b_ptr)[r]  + 
(a a  *  dist)  ; 

bj)(ptrHr]  =  b_p[b_ptrj[r]  +  1  ; 

> 

else  { 

dl  =  back_path[b_ptr][r-1]  +  dist ; 
d2  =  back_path[ptr](r-1]  +  (bb  *  dist) ; 
d3  =  back_path(b_ptr][r)  +  (aa  *  diet) ; 
if  (d2  <=  d3&&  d2  <  d1){ 

back_path[ptr][rj  =  d2  ; 
b_p[ptr][r]  =  b_p[ptr)(r-1]  +  1  ; 
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twoptefi 


•tee  if  (d3  <=  d2  44  d3  <  dl)  { 
back _path[ptr][r]  =  d3  ; 
b_PlP*0M  =  b_p[b_ptr][r)  +  1 ; 
> 


beck_path[ptr][r]  =  dl  ; 
b_p[ptr](r)  =  b_p[b_ptr][r-1]  +  1 
> 


*avo_di8t  =  back _path[ptr][t_length-1]  /  b _p[ptr][1_ler>gth-1] ; 


MntMitttMtmwnHM  nwin5.c 

This  routine  supports  TW0P1C6.C/EXE  which  finds  the  node  closest 
in  OTW(maskQ.lengthQ)  to  a  given  digit. 

Trajectories  are  100  (not  75  as  in  the  first  version)  point  scaJars 
filled  with  trailing  zeros. 


#  include  math 

#  include  stdio 

#  include  stat 


extern  double 
extern  double 

extern  int 
extern  int 
extern  int 
extern  int 
extern  int 
extern  char 
extern  char 


int 

float 

int 

extern  int 
extern  float 


read  trn  file  0 

{ 

FILE 

int 


input[225J ,  r  input  nodes  V 
gain  ; 

closest[2)  ;  /*  closest  node  */ 
neigh[2]  ;  /*  neighbor  •/ 
xsize,  ysize  ;  /*  Size  of  array  */ 
number Jnputs  ; 
train_diacrete  ; 
training_file[30]  ; 
fir8t_net_file[30) ; 

number_di8cretee ; 
word  counter ; 
num  worde ; 
word_number(200][15]  ; 
length  [200] ; 

f_ysize,  f_xsize,  f  numberjnputs  ; 
f_map[20J{20](16] ; 
location[2000][2] ; 
map2[20]  [20]  [  1 00]  [2]  ; 
map[20]  [20]  [225]  ; 


*tf,  *fnet ; 
i,  r,  c,  k,  temp  ; 


tf  =  fopen  (training_file,  "r") ; 
tscanf  (tf,  "%d",  &num_worde) ; 
for  (i  =  0  ;  i  <  num_words  ;  i+  +) 
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twoptc6 


fecanf  (tf,  “%e",  word_number[i]) ; 
fcloee  (tf) ; 
word_  counter  =  0 ; 

fnet  =  (open  (firet_net_file,  "r") ; 

f«c«nf  (fnet"%d  %d  VI",  &f _yeize,  &f_xsize,  &f_number  jnpute)  ; 
for  (r  =  0  ;  r  <  f_ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  f_xei ze ;  c+  +)  { 

for  (i  =  0  ;  i  <  f_number  Jnpute  ;  i  +  +)  { 

fscenf (fnet,"  %f',  &f  mep(r][c)[i]) ; 

> 

> 

> 

fcloee  (fnet) ; 


for  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

P  for  (c  =  0  ;  c  <  xsize  ;  c+  +)  { 

for  (i  =  0  ;  i  <  number_input«  ;•++){ 

temp  =  (int)  7map(r](c){i]  *  226.0  - 1.0) ; 
k  =  temp  %  f_xsize  ; 
map2[r][c)(iJ[1J  =  (temp  -  k)  /f_xaize  ; 
map2[r][c][i](0]  =  k ; 

> 


getin  0 

{ 

if  (word_counter  =  =  num_words) 
word  counter  =  0  ; 
read  word  (word_counter)  ; 
wordcourrter  +  +  , 

) 


get  md  in  0 
{  " 

int 

double 

int 


max_rand  =  pow  (2.0,  31.0)  -1.0; 
pointer ; 


pointer  =  floor  ((randO  *  (num_words  -  .0001)  /  max_rand))  ; 
read_word  (pointer)  ; 


read_word  (pointer) 
int 


{ 


int 

double 

float 


pointer ; 

flag,  r,  c,  i,  j,  k  ; 
in[16],  dl,  d2,  d3,  d4,  d5  ; 
element ; 


int 

FILE 


int 

int 

double 


Ioc2[2000][2],  Ioc3[2000]  [2]  ; 
*fsnd  ; 

sound,  point,  x[5],  y[5]  ; 
maxjats  ; 
max  , 


fsnd  =  fopen  (word_number[pointer),  "r")  , 
sound  =  0  ; 
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i  =  0; 
f  fag  =  o  ; 
while  (flag  1=  1)  { 

facanf  (fend,  “%T,  &eiement) ; 
if  (feof(fsnd)  1=0) 
flag  =  1  ; 
else  if  (i  >  96) 

flag  =  1  ; 

else  { 

in[i]  =  (double)  element ; 

i+  +  ; 

> 

if((i=  =  15)  &&  (flog  ==  0))  { 

f  mindist  (f  map,  in,  &loc2 [sound]  [0]) ; 
i  =0; 
sound*  +  ; 

> 

} 

tcloee  (fsnd) ; 

for  (i  =  0  ;  i  <  sound  ;  i+  +)  { 

Ioc3[i][0]  =  Ioc2[i][0] ; 

*oc3[i][1]  =  toc2[l][1]  ; 

> 

max_pts  =  sound ; 

...  Trajectory  Reduction ... 

for  (i  =  0  ;  i  <  j ;  i+  +)  { 

location^]  [0]  =  Ioc2[i][0]  ; 
location[i][1]  =  loc2[i][1]  ; 

> 

length  [0]  =  j ; 

for  (i  =  j ;  i  <  2000  ;  i++) 

location[i][1]  =  (location [i][0]  =  0)  ; 


fmindist  (f_map,  inp,  close) 

double  inp[l6] ; 

int  close[2]  ; 

float  f  map[20][20](16]  ; 

{ 

int  r,  c,  i ; 

double  dist ; 

double  minimum  =  99999.9  ; 

for  (r  =  0  ;  r  <  f_y$ize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  f_xsize  ,  c+  +)  { 
dist  =  6.0  ; 

for  (i  =  0  ;  i  <  f_number_inputs  ;  i  +  +) 

dist  +  =  pow  (inp[i]  -  f_map[r][c][i],  2.0) 
if  (dist  <  minimum)  { 

minimum  =  dist ; 
close[0]  =  c  ; 
close!  1]  =  r ; 

> 

> 
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twoptefi 


r 

(MMMUMKttl 


lookup6.c 


This  is  e  look-up  table  that  supports  TWOPIC6*  C/EXE  Once 
nodes  are  identified  (either  with  TWOPIC4*  or  TWOP1C6*),  those 
assignments  are  stored  in  the  table  below. 

V 

#  include  stdio 


int  look  up(  100]  =  {9,9,9,3.777,6,6.6. 

9,9, 3, 3, 3, 3, 6,6,6, 6, 
9, 9, 3, 2, 3, 0,6, 6, 6,6, 
1.1. 1,3, 3.0, 3, 6, 6, 6, 
1,1, 1,3, 0,0, 0,4, 4, 4, 
3. 1,9, 3, 0.0, 0.0, 4, 4, 
5,3,3,3,3,37,0,4,0, 
5,5,2,3,2777,8,2, 
5,5,2,2.3,37.4,8,8, 
5,5, 9,3,0, 3,4,3,8,8> 

char  digit[11][10]  =  {"zero", 

“one", 

“two", 

“three", 

“tour", 

"five", 

"six”, 

“eeven", 

"eight", 

“nine", 

“noise"}  ; 

print_digit  (node) 

int  node ; 

{ 

printf  ("%8",  digit[look_up(node]])  ; 

> 


tprint_digit  (node,  flog) 

int  node ; 

FILE  'flog ; 

{ 

fprintf  (flog,  "%s".  digit[look  up(node]])  ; 

} 
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outdat3 


$  link  outdat3,rtraj3,optione  file/opt 
f 

outdat3.c ' 


Thia  routine  create*  a  set  of  stored  trajectories  In  the  file 
path.dat  for  uee  in  training  a  second  Kohonen  net. 


Input  trajectories  are  100  point  scalars  (1-225)  filled  with 
trailing  0‘s. 


Capt  Gary  Barmora,  25  Aug  88 


#  include  math 

#  include  stdio 

#  include  time 


float 

double 


map(20](20][22S]  ;  /*  output  nodes  */ 
Input  [225]  ;  /*  input  nodes  */ 


int 

int 


xsize,  ysize  ;  /•  Size  of  array  V 
number  Jnputs ; 


char 

char 

char 


training_file[30],  net_file[30],  first^net_file[30]  ; 
temp_ftfe[15J ; 
net_name[15]  ; 


mindist  (map,  inp,  close) 
double 
int 
float 


{ 


inp[225]  ; 
close(2] . 

map[20]  [20]  [225]  ; 


int 

double 

double 


r,  c,  i ; 

dist  ; 

minimum  =  9.9*31 


for  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

for  (c  =  0  ;c  <  xsize  ;  c+  +)  { 
dist  =  0  0  ; 

for  (i  =  0  ;  i  <  number  Jnputs  ;  i+  +) 

dist  +=  pow  (inp[i]  -  map[ri(c][i],  2.0)  ; 
if  (dist  <  minimum)  { 

minimum  =  dist ; 
close[0]  =  c  ; 
close(lj  =  r ; 

} 


> 


} 


uaermp  Q 

{ 


int 

int 

struct  tm 
int 


line  ; 
c ; 

•localtimeQ,  *time ; 
*bintim  ; 


do  { 


printf  (“OUTDAT3:  Prepare  training  data,  second  kohonen...  \n\n")  ; 
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outdat3 


print!  (“Enter  name  ot  header  file  containing  words  (lees  hdr):  ”)  ; 

scant  (“%e”,  tempjile) ; 

sprint!  (training_file,  "%a.hdr",  temp_file) ; 

number  Jnputs  =  100  ; 

print!  (“Enter  name  of  pre-processor  Kohonen  net  file  [less  net]:  ")  ; 

scan!  (“%s“,  net_name) ; 

sprint!  (first_net_file,  “%s.net“,  net_name)  ; 

prlntf(“Enter  name  of  data  file  to  create  [less  dat]: ") ; 

scant  (“%8",  net_name) ; 

sprintf  (net_file,  “%s.dat”,  net_name)  , 

printfC  Ready  to  begin?  (y/n)  “)  ; 

while  ((c  =  gate  (stdin))  =  =  "  1 1  c  =  =  \n'  |  j  c  =  =  V) 


mainO 

{ 

extern  unsigned  stklen  ; 
_stklen  =  8192  ; 


userinp  0  :  /*  Get  input  values  */ 
read_tm_file  0  ; 

print!  (“\nNet  file:  %s  saved!\n",  netjile)  ; 

} 

/* 

nMtMMitiMMtnMMiHMMin  ntraj3.c  ***••*•***•**«********•«••* 

This  routine  supports  OUTDAT3.C/EXE  in  creating  a  set  of  stored 
trajectories  (path.dat)  for  training  a  second  Kohonen  net. 

Trajectories  are  100  point  scalars  (0-225)  filled  with  trailing  0's. 


G.  Barmore25  Aug  88 

*/ 


#  include  math 

#  include  stdio 

#  include  stat 


double 

innput[100][100]  J*  input  vectors  */ 

extern  double 

input[225]  ;  /*  input  nodes  */ 

extern  double 

gain ; 

extern  int 

closest[2]  ;  /*  closest  node  */ 

extern  int 

neigh[2]  ;  /*  neighbor  */ 

extern  int 

xsize,  ysize  ;  /*  Size  of  array  */ 

extern  int 

number  Jnputs ; 

extern  int 

train_discrete  ; 

extern  char 

training_file(30]  ; 

extern  char 

first_net_fi!e[30]  ; 

extern  char 

net_file[30]  ; 
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outdat3 


int 

number_discretee ; 

int 

word  counter ; 

int 

num_words ; 

char 

word_number[  1 00]  ( 1 5] ; 

int 

f_ysize,  (  xsize,  (  number  inputs  ; 

float 

f_map[20]  [20]  [1 6]  ; 

read  tm  file  0 

{ 

FILE 

*tf,  *(net ; 

int 

j,  i.  r.  c  ; 

tf  =  (open  (training_filel  “r”) ; 

(scant  (tf,  “%d",  &num_words)  ; 
for  (i  =  0  ,  i  <  num_worda  ;  i  +  +) 

(scant  (tf,  “%a",  word_number[i]) ; 

(close  (t() ; 

(net  =  (open  (first_net_file,  “r")  ; 

(scant  (fnet,'"%d  %d  %d",  &f_ysize,  &f_xsize,  &f_number_inputs)  ; 
(or  (r  =  0  ;  r  <  f_ysize ,  r+  +)  { 

(or  (c  =  0  ;  c  <  f_xsize  ;  c+  +)  { 

(or  (i  =  0  ;  i  <  f_number_inputs  ;  i  +  +)  { 

fscanf  ((net,"  %(",  &f  map(r][c](i])  ; 

} 

} 

} 

(close  ((net)  ; 

(net  =  fopen  (nstjile,  “w")  ; 

(print!  (fnet,  "%d\n'\  num_words)  , 
tor  (i  =  0  ;  i  <  num_words  ;  i+  +)  { 
read_word  (i)  ; 

for  (j  =  0  ;  j  <  numberjnputs  ;  j  +  +)  { 
innput[i][j]  =  input[j]  ; 

(printf  ((net,  "%le\n ",  input[j])  ; 

} 


pointer ; 

flag,  r,  c,  i,  j,  k  ; 
in[16],  dl,  d2,  d3,  d4,  d5  ; 
element ; 

Ioc2[2000][2],  Ioc3[2000](2]  ; 
*fsnd  ; 

sound,  point,  x(5],  y[5]  ; 
max_pts  ; 
max ; 


> 

fclose  (fnet) 


read_word  (pointer) 
int 


int 

double 

float 

int 

FILE 

int 

int 

double 


(or  (i  =  0  ;  i  <  numberjnputs  ;  i  +  +) 
input(i)  =  0.0  ; 

fsnd  =  fopen  (word_number(pointer],  "r")  ; 
sound  =  0 ; 
i  =  0  ; 

(lag  =  0 ; 
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outdatt 


while  (flag  !=  1)  { 

(scant  (fend,  "%T,  &  element) ; 
if  (feot(fand)  1=0) 
flag  =  1  ; 
else  if  (i  >  99) 

flag  =  1  ; 


in[i]  =  (double)  element ; 
i++  ; 

> 

if  ((i  =  =  15)  &&  (flag  =  =  0))  { 

f  mindist  (f  map,  in,  4loc2[sound][0J)  ; 
1=0; 
sound  +  +  ; 

> 

> 

(close  (tend)  ; 

for  (i  =  0  ;  i  <  sound  ;  i+  +)  { 

Ioc3[i][0]  =  Ioc2[i][0]  ; 
loc3(iJ(tJ  =  loc2[i][1] ; 

} 

max_pts  =  sound  ; 

...  Trajectory  Reduction ... 

for  (i  =  0  ;  i  <  j ;  i++)  { 

point  =  1  +  Ioc2[i][0)  +  loc2(i][1]  *  f_xsize  ; 
input[i]  =  point  /  226.0  ; 

> 


f_mindist  (f_map,  inp,  close) 


double 

inp[l6]  , 

int 

close[2]  ; 

float 

f_map[20][20][16J  ; 

int 

r,  c,  i ; 

double 

dist ; 

double 

minimum  =  99999.9 

for  (r  =  0  , 

r  <  t  ysize  ,  r+  +)  { 

for  (c  =  0  ;  c  <  f_xsize  ;  c  +  +)  { 
dist  =  0.0  ; 

for  (i  =  0  ;  i  <  f_numberjnputs  ;  i+  +) 

dist  +=  pow  (inp[i]  -  f_map[r][c][i],  2.0)  ; 
if  (dist  <  minimum)  { 

minimum  =  dist ; 
close[0]  =  c  ; 
c!ose[lj  =  r ; 

} 
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$  link  twobaa3,nweight1 1  .options  ftle/opt 

r 

HHmMttmMMMmnHtmM  tWOb«83.C  •••*«•••••••*•••*•*•••*•* 

These  routines  train  a  second  Kohonen  net  to  process  100  point 
scalar  trajectories  filled  with  trailing  0'e. 

initial  weights  are  random.  Stored  training  trajectories  are 
found  in  a  path. dal  file.  Conscience  is  an  user  supplied  variable 
in  this  version. 


*/ 


Capt  Gary  Barmore,  1  Sep  88 


#  include  math 

#  include  stdio 

#  include  time 

int  conscience[20] [20]  J*  records  #  times  closest  */ 

int  nodes ;  /*  number  of  nodes  */ 

double  consc  =  1.1  ;  /*  conscience  factor  */ 

float  map[20][20][225]  ;  /*  output  nodes  V 

double  input[225]  ;  I*  input  nodes  *1 

double  gain,  noise ; 

double  mcount ; 

double  percent ; 

double  xoff  =  0.0  ; 

double  yoff  =  0.0  ; 

int  closest{2]  ;  /*  closest  node  */ 

int  neigh[2]  ;  /*  neighbor  */ 

int  nrangex,  nrangey  ;  /*  neighbor  range  */ 

int  nfactorx,  nfactory  ;  /*  neighbor  factor  */ 

long  count ;  /*  #  of  iterations  */ 

int  graph  ,  /*  #  between  plots  */ 

int  seed ; 

int  maxneighx,  maxneighy  ;  /*  Starting  area  V 

int  minneighx,  minneighy  ;  /*  Final  area  */ 

int  xsize,  ysize  ;  /*  Size  of  array  */ 

int  numberjnputs ; 

int  wrapjlag  =  0  ; 

int  trainjlag,  train_discrete  ; 

char  training_file[30],  net_file[30],  first_net_file{30]  ; 
char  temp_file[15]  ; 
char  net_name(15]  ; 

struct  cun/e  { 
int 

double 
double 
double 
int 

}  gcurve ; 

struct  fig  { 
int 

}flag; 


type; 
maxgain ; 
mingain  ; 
midgain  ; 
midtime  ; 


rndjn  ; 
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extern  int 
extern  double 
extern  double 
extern  int 


init  (map) 


xyQ  ;  /*  array  holding  x,y  */ 
xdei,  ydei ; 
xtow,  xup,  ylow  yup  ; 
tr_length ; 

map[20]  [20]  [22S]  ; 

r,  C,  i ; 

max_rand  =  pow(2.0,  31.0)  - 1.0  ; 


nodes  =  ysize  *  xsize  ; 
tor  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  xsize  ;  c+  +)  { 
conscience^]  [c]  =  0  ; 
for  (i  =  0  ;  i  <  number_inputs  ;  i  +  +)  { 

map[r][c][i]  =  rand  0 1  max  rand  ; 

} 

} 

} 


mindist  (map,  inp,  close,  its) 
double  i 

int  i 

float  i 

long  i 


int 

double 

double 


inp[225]  ; 
close[2]  ; 

map[20][20](22S]  ; 
its  ; 

r,  c,  i ; 
dist ; 

minimum  =  9.99e31 


for  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

for  (c  =  0  .  c  <  xsize  ;  c+  +)  { 
dist  =  0.0  ; 

if  (conscience[r][c]  <  consc  *  its  /  nodes )  { 
for  (i  =  0  ;  i  <  number_inputs  ;  i  +  +) 

dist  +=  pow(inp(i)  •  map[r][c][i],  2.0); 
if  (dist  <  minimum)  { 

minimum  =  dist ; 
clos9(0]  =  c  ; 
ciose(1]  =  r ; 

> 


ccnscience(close[1]][close[0]]  +  =  1  ; 


userinp  0 

{ 


printf  (''TWOBAS2:  TWO  KOHonen  net  training  (output  only)...  \n\n"' 

printf  (“Enter  conscience  facto'’  (>  1.0):  [float]  ”)  ; 
scant  ("%f",  &C0H8C)  ; 
if  (consc  <  1  0) 
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conac  =  1.5 ; 


printf("Enter  size  ‘m  n'  (for  an  m  x  n)  of  array  =  ?  [int  irrt]  ")  ; 
8canf(“%d  %d",  &ysize,  &xaize)  ; 
if  (ysize  <  2) 

yaiza  =  2  ; 
aisa  if  (yaiza  >  20) 

yaiza  =  20 ; 
if  (xaiza  <  2) 

xaiza  =  2 ; 
elaa  if  (xaiza  >  20) 

xaiza  =  20  ; 


!( 


!• 


h 


K 


printf  ("Do  you  want  0)  sequential  training,\n")  ; 
printf  (“  1)  randomized  training?  ") ; 
scant  (“%d",  Afiag.mdjn) ; 

printf  ("Enter  name  of  header  file  containing  words  (leas  hdr):  ")  ; 

scant  (“%s",  tempjile) ; 

sprintf  (training_file,  “%a.hdr",  tempjila)  ; 

train_discrete  =  1  ; 
numbarjnputs  =  100 ; 

printf  ("Enter  name  of  pre-processor  Kohonen  net  file  [lees  net):  ")  ; 

scant  ("%e",  net_name)  ; 

sprintf  (first_net_file,  "%a.net",  net_name)  ; 

printf("Enter  name  of  net  file  to  create  [less  net):  ")  ; 

scant  (“%8  net_name)  ; 

sprintf  (netjile,  "%s.net",  net_name)  ; 

printf  (“Number  of  iterations  =  ?  [int]  ")  ; 
scant  (“%ld",  &count)  ; 
if  (count  <  =  10  1 1  count  >  200000) 
count  =  100  ; 
mcount  =  (double)  count ; 

printf  ("Number  of  iterations  between  status  messages  =  ?  [int]  ")  : 
scant  ("%d",  &graph)  ; 
if  (graph  <  1  1 1  graph  >  count) 
graph  =  10  ; 


ing^in  0  I 

printf  ("Starting  size  of  neighborhoods  yn  xn'  =  ?  [int  int]  ")  ; 
scant  ("%d  %d",  &maxneighy,  &maxneighx)  ; 
if  (maxneighx  <  2  1 1  maxneighx  >  xsize  -  1) 
maxneighx  =  2  ; 

if  (maxneighy  <  2  1 1  maxneighy  >  ysize  - 1) 
maxneighy  =  2  ; 

printf  ("Final  size  of  neighborhoods  yn  xn'  =  ?  [int  int] ")  ; 
scant  ("%d  %d",  iminneighy,  &minneighx)  ; 
if  (minneighx  <  1  1 1  minneighx  >  maxneighx) 
minneighx  =  1  ; 

if  (minneighy  <  1  1 1  minneighy  >  maxneighy) 
minneighy  =  1  , 


printf 
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(“Initial  seed  tor  random  #  generator  =  ?  [int]  "); 
scant  (“%d",  &seed) ; 
it  (seed  ==0)  { 

seed  =  138; 

> 

stand  (seed) ; 
wrapttag  =  0 ; 

printt(“Ready  to  begin?  (y/n)  ")  ; 

while  ((c  =  gate  (stdin))  *  =  "  1 1  c  =  =  Vi'  1 1  c  =  =  V) 

}  while  (c  !  =  'y')  : 


ingain  0 

int  line ; 

printt(“For  gain  enter  0)  LINEAR  1)  SIGMOIDAL,  2)  PIECEWISE  UNEAR  :  "); 
scant  (“%d".  igcurve.type) ; 

if  (gcurve.type  =  =  0  1 1  gcurve.type  =  =  1)  { 
l  print!  (“Maximum  gain  =  ?  [float]  “)  ; 

scant  (“%E",  Agcurve.  maxgain)  , 
if  (gcurve.maxgain  >=  1.0  1 1  gcurve  maxgain  <  =  0  0) 
gcurve.maxgain  =  .99 ; 

printt  (“Minimum  gain  =  ?  [float]  ")  ; 
scant  ("%E",  &gcurve. mingain)  ; 

I  it  (gcurve.mingain  <  =  0.0  |  ]  gcurve. mingain  >  =  1.0) 

gcurve. mingain  =  0  0  ; 

} 

else  { 

printt  (“First  segment  starting  gain  =  ?  [float]  “) 
scant  (“%E",  Agcurve. maxgain)  ; 
if  (gcurve.maxgain  >=  1.0  1 1  gcurve.maxgain  <=  0.0) 
j  gcurve.maxgain  =  .99  ; 

printt  ("Second  segment  starting  gain  =  ?  [float]  “)  ; 
scant  (“%E".  Sgcurve. midgain)  ; 
if  (gcurve.midgain  <  =  0.0  1 1  gcur.  e. midgain  >  =  1.0) 
gcurve.  midgain  =  0.0  ; 

I  printt  ("Second  segment  starting  iteration  -  ?  [float]  ")  ; 

scant  ("%d",  &gcurve. midtime)  ; 
it  (gcurve.midtime  <  =  0  1 1  gcurve  midtime  >  count) 
gcurve.  midtime  =  count  /  2  ; 

gcurve.mingain  =  0.0  ; 

} 


getgain  (i) 

long  i  ; 

{ 

if  (gcurve  type  =  =  0) 

gam  =  (percent  *  (gcurve  maxgain  ■  gcurve. mingain))  + 
gcurve.mingain  ; 

I  else  it  (gcurve.type  =  =  1) 
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gain  =  0.9  *  (gcurve.maxgain  -  gcurve.mingain)  /  (1.0  +  exp  (i  - 
count/ 2.0))  +  .1  ; 

else  { 

if  (i  <  gcurve.  midtime) 

gain  =  gcurve.maxgain  •  (1.0  -  (double)  i  /  gcurve. midtime) ; 

else 

gain  =  gcurve.midgain  *  (1.0  -  (double)  i  /  count) ; 


save  net  0 

{ 

int  r,  c,  i ; 

FILE  *fnet ; 


fnet  =  fopen(net_file,"w")  ; 

fprintf  (fnet,"%d  %d  %d",  ysize,  xsize.  numberjnputs) ; 
for  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  xsize  ;  c+  +)  { 

for  (i  =  0  ;  i  <  number Jnputs  ,  i  +  +)  { 

fprintf  (fnet, "  %f",  map[r][c}[i]>  ; 

} 

> 

> 

fclose  (fnet)  ; 

> 


mainO 

{ 


long 

char 

int 

int 

FILE 

extern  unsigned 


i ; 

si  [10]; 
ws_id  =  1  ; 
clear_flag  =  1; 
*tf ; 

_stklen ; 


_stklen  =  8192  , 

userinp  0  ;  /*  Get  input  values  *1 
rrfactorx  =  maxneighx  -  minneighx  +■  1  ; 
nfactory  =  maxneighy  -  minneighy  +  1  ; 
init  (map)  ;  /*  Initialize  weights  */ 
read_trn_file  0  ; 


for  (i  =  1  ;  i  <  =  count ;  i  +  +)  { 
if  (i  %  graph  =  =  0)  { 

printf  (“TV/OBAS3:  gain  =  %f,  yrange  =  %d,  ”, 
gain,  nrangey)  ; 

printf  ("xrange  =  %d,  iteration  #  %d'\  nrangex.i) ; 
printf  (”  (of  %ld)\n",  count)  ; 
if  (access  (net  Jile.O)  =  =  0) 
delete  (netjile)  ; 
save  net  0  ; 

> 

percent  =  (mcount  -  i)  /  mcount ; 
getgain  (i)  ; 
if  (flag.rndjn  =  =  0) 
getin  0  ; 

else 

get_rnd_in  0  ; 

mindist  (map,  input,  closest,  i)  ; 
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> 

/* 


V 


if  (gcurve.type  !  =  2)  { 

nrangax  -  minneighx  +  percent  *  nfactorx  ; 
nrangey  =  minneighy  +  percent  *  nfactory  ; 

> 

else  if  (i  <  gcurve.  midtime)  { 

nrangax  =  minneighx  +  nfactorx  * 

((double)  (gcurve. midtime  -  0)  /  gcurve. midtime  ; 
nrangey  =  minneighy  +  nfactory  * 

((double)  (gcurve. midtime  -  Q)  /  gcurve. midtime  ; 

> 

else  { 

nrangax  =  minneighx ; 
nrangey  =  minneighy  ; 

> 

neigh[0]  =  nrangax  ; 
neigh[lj  =  nrangax ; 
weightem  (map)  ; 

> 

save  net  0  ; 

printf  (“\nNet  file:  %s  saved!\n",  netjiie)  : 


rweightl l.c  «»*****»**»**«*»«»•*»••••*»•*• 

These  routines  support  TWOBAS3.C/EXE  in  training  a  second  Kohonen 
net  with  100  point  scalar  inputs  filled  with  trailing  0's.  It 
uses  stored  training  inputs  in  a  pathdat  file. 


Q.  BARMORE25  AUQ  88 


#  include  math 

#  include  stdio 

#  include  stat 


double 

innput[100][100]  J‘  input  vectors  */ 

extern  double 

input[225]  ;  /*  input  nodes  */ 

extern  double 

gain ; 

extern  int 

closest[2]  ;  /*  closest  node  */ 

extern  int 

neigh[2]  ,  /*  neighbor  V 

extern  int 

xsize,  ysize  ;  /*  Size  of  array  */ 

extern  int 

numberjnputs  ; 

extern  int 

train_discrete  ; 

extern  char 

training_file(30]  ; 

extern  char 

first_net_file{30)  ; 

int 

number_discretes ; 

int 

word_counter ; 

int 

num_words ; 

char 

word_number[100J[15]  , 

int 

float 

read  tm  file  0 
{ 

FILE 

f_ysize,  f  xsize.  f  number  inputs  ; 
f_map[20]  [20]  [  1 6]  ; 

*tf,  *fnet : 
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int  j,  i,  r,  c  ; 

tf  =  (open  (trainingjile,  Mr")  ; 
fscanf  (tf,  "%d",  &num_worda) ; 
for  (i  =  0  ;  i  <  num_worda  ;  i+ +) 

fscanf  (tf,  word_number(i]) ; 
fcloee  (tf) ; 

fnet  =  fopen  (first_net_.fi le,  “r") ; 

fscanf  (fnet,"%d  %d  %d",  &f_ysize,  &f_xsize,  &f_number  Jnputs) 
for  (r  =  0  ;  r  <  f_yai ze  ;  r+  +)  { 

for  (c  =  0  ;  c  <  f_x8ize  ;  c++)  { 

for  (i  =  0  ;  i  <  f_number Jnputs  ;  i  +  +)  { 

fscanf  (fnet,"  %f’',  &f  map[r][c][i])  ; 

> 

> 

> 

feiose  (fnet)  ; 

fnet  =  fopen  ("path  dat",  “r") ; 
fscanf  (fnet,  "%d",  &num_words)  ; 
for  (i  =  0  ;  i  <  num  words  ;  i  +  +)  { 

for  (j  =  0  ;  j  <  number Jnputs  ;  |  +  +) 

fscanf  (fnet.  “%le",  &innput[i][j])  ; 

} 

fclose  (fnet)  ; 
word  counter  =  0  ; 

> 

getin  0 

{ 

int  j ; 

if  (word  counter  =  =  num_words) 
word_counter  =  0 ; 
for  (j  =  0  ;  j  <  number  Jnputs  ;  j+  +) 

input(j]  =  innput[word_courrter][j]  ; 
word  counter ++  ; 

> 

get  md  in  0 

{ 

int  i,  j ; 

double  max_rand  =  pow  (2.0,  31  0)  -10; 

int  pointer ; 

pointer  =  floor  ((randO  *  (num_words  -  .0001)  /  max_rand))  ; 
for  (j  =  0  ;  j  <  number  Jnputs  ;  j-t-  +) 

inputy]  =  innput[word  counter]  [j]  ; 

> 

weightem  (map) 

float  map[20][20]  [225]  ; 

{ 

int  nright,  nleft,  nup,  ndown,  r ,  c,  i ; 

if  (neigh[0]  >  0  &&  neigh[1]  >  0)  { 

nright  =  closest[0]  +  neigh[0]  -  1  ; 
if  (nright  >  =  xsize) 

nright  =  xsize  •  1  ; 
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ntett  =  cloeeat[0]  -  ne<gh[0]  +  1  ; 
if (nleft  <  0) 

nleft  =  0 ; 

nup  =  cloeeet(1]  -  neigh[1]  +  1  ; 
if  (nup  <  0) 

nup  =  0 ; 

ndown  =  closeet[1]  +  neigh(1]  - 1  ; 
if  (ndown  >  =  ysize) 

ndown  =  ysize  ■  1  ; 

> 

else  { 

nrtght  =  cioaest[0] ; 
nleft  =  closest[0] ; 
nup  =  ciosest[1] ; 
ndown  =  closest[1] ; 

} 

for  (r  =  nup;  r  <  =  ndown  ;  r+  +)  { 

for  (c  =  nleft ;  c  <  =  nright ;  c  +  +)  { 

for  (i  =  0  ;  i  <  number  jnputs  ;  i+  +) 

map[r][c][i]  +=  gain  *  (input[i]  -  map[r][c][i])  ; 

} 

> 


read_word  (pointer) 

int  pointer ; 

{ 

int  flag,  r,  c,  i,  j,  k  ; 
double  in[16],  dl,  d2,  d3.d4.d5; 
float  element ; 

int  Ioc2[2000][2],  Ioc3(2000][2)  ; 

FILE  *fsnd  ; 

int  sound,  point,  x[5],  y(5]  ; 
irrt  max_pt8 ; 
double  max ; 

for  (i  =  0  ;  i  <  number  jnputs  ;  i  +  +) 
input[i]  =  0.0  ; 

fsnd  =  fopen  (word_number[pointer],  “r")  ; 

sound  =  0 ; 

i  =  0; 

flag  =  0  ; 

while  (flag  !=  1)  { 

fscarrf  (fsnd,  "%f",  4element)  ; 
if  (feof(f8nd)  !=0) 
flag  =  1  ; 
else  if  (i  >  99) 

flag  =  1  ; 

else  { 

infij  =  (double)  element  ; 
i++  ; 

> 

if  «i  =  =  15)  44  (flag  =  =  0))  { 

f  mindist  (f  map,  in,  4loc2[sound][0])  ; 
i  =  0 ; 
sound ++  ; 

> 
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fcloee  (fend) ; 

for  (i  =  0  ,  i  <  sound  ;  i+  +)  { 

Ioc3[i](0]  =  Ioc2(i][0]  ; 

>oc3{i][1J  =  loc2[i][1J ; 

> 

maxjats  =  sound ; 

...  Trajectory  Reduction  ... 

for  (i  =  0  ;  i  <  j ;  i+ +)  { 

point  =  1  +  Ioc2li][0]  +  loc2[i][l)  *  f_xaize  ; 
input[i]  =  point  /  226.0  ; 

> 


fjnindist  (f_map,  inp,  close) 


doubts 

inp(16]  ; 

int 

close[2]  ; 

float 

f_map[20]  (20]  [  1 6]  ; 

int 

r,  c,  i ; 

double 

dist ; 

double 

minimum  =  9.99e31 

for  (r  =  0  ; 

;  r  <  f_yaize  ;  r-t-+)  { 

for  (c  =  0  ;  c  <  f_xsize  ;  c+  +)  { 
dist  =  6.0 ; 

for  (i  =  0  ;  i  <  f_number_inputs  ;  i+  +) 

dist  +  =  pow  (inp(i]  -  f_maptr][cl[i],  2.0) ; 
if  (dist  <  minimum)  { 

minimum  =  dist ; 
close[0]  =  c  ; 
ciosejlj  =  r ; 

> 

> 
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$  link  twopic4b,npiot,nprint*r,mat3,nweight12, options  tile/opt 
f 

tWOptC4b.C  **•»••»**••»••••»••»••*•< 

This  routine  ia  uaed  to  show  graphically  those  nodes  which  light 
up'  using  Euclidean  distance  when  the  training  set  of  inputs  is 
applied  to  a  second  Kohonen  net. 

Inputs  are  100  point  scalar  (1  -225)  trajectories  filled  with 
trailing  0's. 


V 


#  include  math 

#  include  stdio 

#  include  time 

float 

map(20][20]  [225J  ;  /*  output  node*  V 

double 

input(225]  ;  /*  input  node*  V 

double 

gain,  noise ; 

double 

mcount ; 

double 

percent ; 

double 

xoff  =  0.0  ; 

double 

yoff  =  0  0  ; 

double 

node  dist ; 

int 

ciosest[2]  ;  /*  closest  node  */ 

int 

neigh{2]  ;  /*  neighbor  */ 

int 

nrangex,  nrangey  ;  /*  neighbor  range  */ 

int 

nfactorx,  nfactory  ;  /*  neighbor  factor  */ 

long 

count ;  /•  #  of  iterations  */ 

int 

graph  ;  /*  #  between  plots  */ 

int 

seed  ; 

int 

maxneighx,  maxneighy  ;  /*  Starting  area  */ 

int 

minneighx,  minneighy  ;  /*  Final  area  •/ 

int 

xsize,  ysize  ;  /*  Size  of  array  V 

int 

number Jnputs  ; 

int 

wrap  flag  =  0 ; 

int 

train  flag,  train_discrete  ; 

char 

training_file[30],  temp_file[30),  first_net_file[30) 

char 

net_file[30]  ; 

struct  curve  { 

int 

type  ; 

double 

mexgain ; 

double 

mingain  ; 

double 

midgain  ; 

int 

midtime ; 

}  gcurve 

extern  int 

xyQ  ;  /*  array  holding  x.y  */ 

extern  double 

xdel,  ydel  ; 

extern  double 

xlow,  xup,  ylow,  yup  ; 

extern  int 

num_words  ; 

extern  char 

word_number[100][15]  ; 

mindist  (map.  inp,  close) 

double 

inp[225]  ; 

int 

close[2]  ; 

float 

map[20][20][225]  ; 

-m 


i 
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int  r,  c,  i ; 

double  diet ; 

double  minimum  =  9.99*31  ; 


> 


tor  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  xsize  ;  c+  +)  { 
diet  —  0.0 ; 

for  (i  =  0  ;  i  <  number_inputs  ;  i+  +) 

dist  +=  pow  (inp[i]  ■  map[r](cj[i],  2.0) ; 
if  (dist  <  minimum)  { 

minimum  =  dist ; 
cloee[0]  =  c ; 
close{lj  =  r , 

} 

> 

> 

nodedist  =  minimum  ; 


main  0  / 

{ 

int  c ; 


} 


printf  (“\nTWOPIC4b  (Plot  Words  tor  0/1  Reduced  Queued  Traj)...\n") ; 
map_ speech  0  ; 


map  speech  0 
{ 

int 

char 

char 

int 

FILE 

int 

short 


r.  c,  i,  /,  k  ; 

sub_title[60],  temp[3Q]  ; 
name  trj(20]  ; 
loc[125][2]  ; 

*fnet,  *flog  ; 
sound  ; 
length  ; 


printf  ("\nEnter  name  of  pre-processor  Koh  net-file  [less  net):  ")  ; 

scanf  (“%s",  temp)  ; 

sprintf  (first_net_file,  "%s.net",  temp)  ; 


printf  ("Enter  name  of  header  file  containing  words  (less  hdr):  ")  ; 

scanf  (“%s”,  temp_file) ; 

sprintf  (trainingjile,  ''%s.hdr",  tempjile)  ; 

printf  (“Enter  name  of  output  Koh  netjile  [less  net]:  ")  ; 

scant  ("%s”,  tempjile)  ; 

sprintf  (netjile.  "%s.net”,  tempjile)  ; 


readjrnjile  0  ; 

fnet  =  fopen  (netjile,  "r”)  ; 

fscanf  (fnet,"%d  %d  %d",  Sysize,  &xsize,  &number_inputs)  ; 
for  (r  =  0  ;  r  <  ysize  ;  r++)  { 

tor  (c  =  0  ;  c  <  xsize  ;  c+  +)  { 

tor  (i  =  0  ;  i  <  number_inputs  ;  i+  +)  { 

fscanf  (fnet,"  %f”,  &map[r][c][i])  ; 

} 

} 
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> 

fcloee  (fnat) ; 

sprintf  (subjitle,  “%#  ->%•->",  fir*t_netjile,  netjile)  ; 
sprintf  (namejrj,  “Na.trj”,  temp) ; 


flog  =  fopen  (“temp.log", "w") ; 
tprintf  (flog,  “TWOPtC4b:  %e",  namejrj) ; 

graph Jest  (training_file) ; 
length  =  (short)  stiien  (subjitle) ; 
draw_grid2  (ysize,  xsize,  subjitle,  I  sngth)  ; 

printf  ("\nExpect  %d  calculation*.  \n”,  num_words) ; 
for  (sound  =  0 ;  sound  <  num_words  ;  sound  +  +)  { 
getin  0  ; 

mindist  (map,  input,  &loc[sound][0])  ; 
printf  (“%d  :  [%d,%d]  diet  =  %le\n  ", 

sound,  loc[sound][0],  loc[sound][1],  nodejiist)  ; 
fprintf  (flog,  “%d  :  (%d,%d)  dist  =  %le\n", 

sound,  loc[sound][0],  loc(sound][1],  node  dist)  ; 

} 

printf  ("\nCaJculations  finiahedAn ")  ; 
fclose  (flog)  ; 

draw  speech  map  (sound,  loc)  ; 
scanf  (“%s",temp)  ; 
clipoff  0  . 
graphoff  0  i 

} 

graph  Jest  (name) 

char  name(30]  ; 

{ 

char  title(79),  labelx[79]  ; 

float  xloc[5]  =  {0,  639  0,  639.0,  0.0,  0.0}  , 

float  yloc[5]  =  {349.0,  349  0,  0  0,  0.0,  349  0}  ; 

int  points  =  5  ; 

int  wsjd  =  1  ; 

int  clear  Jlag  =  1  ; 

short  length ; 

sprintf  (title,  "TVI/OPIC4b:  Kohonen  TWO  NETS  •*  %s ",  name)  ; 
sprintf(labelx."  ”)  ; 
graphon  0  I 

gks$clear_ws  (&wsjd,  &clearjlag)  ; 
gks$ polyline  (Apoints,  xloc,  yloc)  ; 
prepcolmat  (ysize,  xsize) ; 
length  =  (short)  strlen  (title)  ; 
outtitle  (title,  length)  ; 
length  =  (short)  strlen  (labelx)  ; 
outlabebt  (labelx,  length)  ; 
clipon  0  ; 

> 

/* 

MtMMnMtnnntnMtMniMM  mat3,C  ******•****«**•*«*»•*»»**»*»»»»»* 

These  routines  support  graphics  operations  in  showing  which  node  in 
a  second  Kohonen  net  lights  up  when  the  training  set  of  trajectories 
is  applied. 
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Trajectories  are  100  point  scalars  with  trailing  0’s. 

*/ 

#  include  stdio 

#  include  math 

#  include  <gksdefs.h> 

#  include  <deecrip.h> 

#  define  BLACKS 

#  define  WHITE  1 


float 

Pt*x[20](20J[5],  ptsy[20](20][51 

float 

px[20](20],  py[20J(201  , 

int 

used  [20]  [20]  ; 

int 

colmat[20][20] ; 

int 

pattern  [16]  = 

{0.  -15,-15,  -12,-12,  -11,-11,  -1,- 

prepcolmat  (ysize.  xsize) 

int 

xsize ; 

int 

{ 

int 

ysize  ; 

r,  c.  xstart,  ystart  ;  * 

int 

dx,  dy  ; 

dx  =  floor  (550  0  /  xsize)  ; 
dy  =  floor  (276.0  /  ysize)  ; 

xstart  =  280  -  dx  *  xsize  /  2  ; 
ystart  =  148  +  dy  *  ysize  /  2  ; 

for  (c  =  0  ;  c  <  xsize  ;  c+  +)  { 

for  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

ptsx[r][c]|4]  =  (ptsx[r][c][3]  =  (ptsx[r][c][0]  = 
xstart  +  c  *  dx))  ; 

ptax(r](c)[2]  =  (ptsx[r](c](1]  =  ptsx[r)[cj [0]  +  dx-  1)  ; 

ptsy[r][c)[4]  =  (ptsy[r][c][1]  =  (ptsy[r][c][0]  = 
ystart  -  r  *  dy))  , 

ptsy(r](c][3]  =  (ptsy[r)(c){2]  =  ptsy[r][c] [0]  -dy-t-  1)  , 

Px(r][c)  =  ptsx[r](c][0]  +  8  0  ; 
py[rj[cj  =  ptsy(r](c](0]  -  8.0  ; 

> 

} 

for  (r  =  0  ;  r  <  20  ;  r+  +)  { 

for  (c  =  0  ;  c  <  20  ;  c  +  + )  { 
used{r][c]  =  0  ; 

} 


showem  0 

{ 

int  i  ; 

float  rectx[16][6],  recty[16][6]  ; 

int  points  =  5  ; 

for  (i  =  1  ;  i  <  16  ;  i  +  +)  { 
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rectx[i][4]  =  (rectx{i](3]  =  (rectx[i][0]  =  173  +  16  *  0) ; 
rectx[ij{2]  =  (r«ctx[i][1]  =  (r«ctx(i] [0]  +  15)) ; 

recty{i][4]  =  (recty{ij{1]  =  (recty[i}[0]  =  30)) ; 
recty[i][3]  =  (recty[i][2]  =  23) ; 

setfillstyle  (pattern  [i],  i) ; 

gksSfill  area  (&points,  &rectx[i][0],  &recty[i}[0]) ; 

> 

} 

setfillstyle  (pattern,  pointer) 
int  pattern ; 

int  pointer ; 

{ 

int  style  =  3  ;  /*  hatch  *1 

int  color[16]  =  {0,  7,7,  3,3,  5,5,  4,4,  4,  6,6,  2,2,  1}  ; 

if  (pattern  >  =  0)  { 

gks$set  fill  int  style  (&pattern)  ; 

} 

else  { 

gks$set_fill_style_index  (ipattern)  ; 
gks$set_fill_int  style  (&8tyle)  ; 

} 

> 

draw_net  (number,  loc) 

int  number,  loc[64][2]  ; 

{ 

int  i,  old_value ; 

int  white  =  0  ; 

int  black  =  1  ; 

float  x,  y  ; 

char  s[4] ; 

$DESCRIPTOR(s_dsc.s)  ; 

for  (i  =  0  ;  i  <  number  ;  i+  +)  { 

x  =  ptsx[loc[i][1]][loc[i][0]][0]  +  4  0  ; 
y  =  ptsy[loc[i][1]][loc[i][0]](0]  -  4.0  ; 
old_value  =  used[loc(i][1]](loc[i][0]]  ; 

gks$set_text_color_index  (&white)  ; 
sprint!  (8, "%3d",-old_value)  ; 
gks$text  (&x,  &y,  &s_dsc)  ; 

sprintf  (s,"%3d  ",i +1)  ; 
gks$aet_text_color_index  (&black)  ; 
gksStext  (&x,  &y,  Ss_dsc)  ; 

if  ((i  +  1  !=  old  value)  &&  (old  value  !  =  0))  { 
y  -=”6.0  ; 
sprintf  (s, ”***")  ; 
gksStext  (&x,  &y,  &s  dsc)  ; 

) 

used[loc(i][1]](loc(i](0)]  =  i  +  1  ; 

} 

> 

draw_neighbors  (number,  loc) 
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« 


« 


« 


int  number,  k>c[64][2] ; 

int  i,  old_value ; 

int  white  =  0  ; 

int  black  =  1  ; 

float  x,  y  , 

char  s[4] ; 

$OESCRiPTOR(s_dac,8) ; 

for  (i  =  0  ;  i  <  1  ;  i++)  { 

x  =  ptax[loc[i]  [1  ]]  [loc[i]  [0]]  [0]  +  4.0  ; 
y  =  pt*y[loc[il[1]][loc[i][0]][0]  -  4.0  ; 
old_value  =  used[loc[i][1]][loc[i][0]]  ; 

gks$8et_text_color_index  (&white)  ; 
sprintf  (s,"%3d",  oid_value)  ; 
gks$text  (&x,  &y,  &s_dsc)  ; 

sprintf  (8,"%3d",  (number+1))  ; 
gks$set_text_color_index  (&black)  ; 
gks$text  (&x,  &y.  &s_dsc)  ; 

if  ((number+1  !=  old_value)  &&  (old_value  !=  0))  { 
y  -=  6.0  ; 
sprintf  (a,''***")  ; 
gks$text  (&x,  &y,  &s  dsc)  ; 

} 

used[loc[i][l]][loc[i][0]]  =  number  +  1  ; 


draw  speecn  map  (number,  loc) 

int  number,  loc[125][2]  ; 

{ 

int  i,  old_vaJue  ; 

int  white  =  0  ; 

int  black  =  1  ; 

float  x,  y,  xx[2],  yy[2]  ; 

int  points  =  2  ; 

char  s[4] ; 

$OESCRIPTOR(8_d8c,s)  ; 

for  (i  =  0  ;  i  <  number  ;  i  +  +)  { 

x  =  pt3x[loc[i][1]][loc[i][0]][0]  +  4  0  i 
y  =  ptsy [loc [i]  ( 1  ] ]  [loc [i]  (0] ]  [0]  -40; 
old_value  =  used[loc[i][l]][loc[i][0]]  ; 

gks$3et_text_color_index  (&white)  ; 
sprintf  (s,  "%Sd",  old_value)  ; 
gks$text  (&x,  &y,  &s_dsc)  , 

gks$set_text_color_index  (&black)  ; 
sprintf  (s, "%3d",  i  +  1)  ; 
gks$text  (&x,  &y,  &s_dsc)  , 

if  ((i  +  1  !=  old_value)  &&  (old_value  !  =  0))  { 
y  -=  6.0 ; 
sprintf  (s, "•••")  ; 
gksStext  (&x,  &y,  &s  dsc)  ; 

> 


# 
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uaad(k>c[n{imiocli![01]  =  i+1  ; 

M(1!=0){ 

w[0)  =  px[loc[i-1][1]][loc[i-l][0J]  ; 
xx[1]  =  px[k>c[i][11](loc[i][0]]  ; 
yy[Q)  =  py(ioc[M][ii][ioc[i-iH0i] , 
yy[ij  =  pypociniilltioctnioii ; 

/• 

gksSpotylina  (&points,  xx,  yy) ; 

•/ 

> 

} 

i 

dr«w_flrid  (ysiza,  xsiza) 

int  xsiza,  ysiza ; 

{ 

int  points  =  S  ; 

int  r,  c  ; 

lor  (r  =  0  ;  r  <  ysiza  r+  +)  { 

for  (c  =  0  ;  c  <  xsiza  ;  c+  +)  { 

gks$po4ylina  (&points,  &ptsx[r][c][0],  &ptsy(r][c](0]); 

> 

} 

> 

draw_spectra  (map,  ysiza,  xsiza) 
int  xsiza.  ysiza ; 

float  map(20][20J[16]  ; 

{ 

int  points  *  2  ; 

float  x[2],  y[2]  ; 

int  r,  c,  i ; 

for  (r  =  0  ,  r  <  ysiza  ;  r+  +)  { 

for  (c  =  0  ;  c  <  xsiza  ;  c+  +)  { 
y[0]  =  ptsy(r](c][3]  , 
for  (i  =  0  ;  i  <  15  ;  i+  +)  { 

x[0]  =  ptsx[r](c](3]  +  2.0  +  (2.0  *  i)  ; 
x(1]  =  x(0]  ; 

y[1]  =  y(0]  +  16.0  •  map[r][c][i]  . 
gksipolyline  (&points,  x,  y)  ; 
x(0]  +=10; 
x(1)  +=1.0; 

gks$poiylina  (&points,  x,  y)  ; 

> 


draw_grid2  (ysiza,  xsiza,  sub_titla,  langth) 
int  xsiza,  ysiza  ; 

char  sub_titla{30]  ; 

short  langth ; 

{ 

int  points  =  5  ; 

int  r,  c ; 

float  xloc,  yloc  ; 

struct  dsc$daacriptor  tit  la  dsc  =  {  langth, 

DSC$K_0TYPE_T, 
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DSC$K_CLASS_S, 
subjitle } ; 

for  (r  =  0 ;  r  <  yeize ;  r++)  { 

for  (c  =  0  ;  c  <  xeiz*  ;  ct- 1-)  { 

gksSpoiyline  (ipoints,  &ptex[r][c][0],  &pt*y[r][c][0]); 

> 

} 

xloc  =  277.0  -  3.0  *  length  ; 
yloc  =  2.0  ; 

gk*$text  (&xloc,  &yloc,  &title_dsc) ; 


etetueem  (gain,  orangey,  nrangex,  it*) 
double  gain ; 

int  orangey,  nrangex ; 

long  Its ; 

{ 

float  xloc,  yloc ; 

char  s[60]  ; 

$DESCRIPTOR(a_dac,8)  , 

sprintf  (a, 

“Gain  =  %4.2f  Neighbors  =  %2d.%2d  Iteration  #  %5ld" 
gain,  nrangey,  nrangex,  its) ; 
xloc  =  76.0  ; 
yloc  =  2.0 ; 

gks$text  (&xk)c,  &yloc,  &s_dsc)  ; 


colorem  (ysize,  xsize) 

int  xsize,  ysize ; 

{ 

int  r,  c,  color ; 

int  points  =  5  ; 

for  (r  =  0  ;  r  <  ysize  ,  r  +)  { 

for  (c  =  0  ;  c  <  xsize  ;  c+  +)  { 
color  =  colmat[r][c} ; 
setfillstyle  (pattern[color],  color)  ; 
gks$fill  area(&points,  &ptsx[r][c][0],  &ptsy[r][c][0j); 
} 

> 


twopic4b 


pickcolors  0 

{ 

return  ; 

> 


'  nweight12.c ' 


These  routines  support  TWOPIC4B.C/EXE  in  showing  which  nodes  of 
a  Kohonen  net  light  up  whan  the  training  set  of  trajectories  is 
applied. 

Trajectories  are  100  point  scalar  (1-225)  inputs  filled  with 
trailing  0's. 
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#  include  math 

#  include  otdio 

#  include  atat 


twopieab 


extern  double  input[225] ;  /*  input  nodes  */ 

extern  double  gain ; 

extern  int  doeeet[2] ;  I*  cloeeet  node  */ 

extern  int  neigh[2] ;  /*  neighbor  */ 

extern  int  xsize.  ysize  ;  /*  Size  at  array  */ 

extern  int  number  Jnputs  ; 

extern  int  train_discrete ; 

extern  char  training_file(30]  ; 

extern  char  fir*t_net_file[30] ; 

int  number_discretee ; 

int  word_counter ; 

int  num  worda ; 

char  wor<f.number[  1 00][1 5] ; 

int  f_yaize,  f  xsize,  f_number  jnputs  ; 

float  »_map(20H20H16] ; 


read  tm  file  0 

{ 

FILE 

int 


*tf,  *fnet ; 

i,  r,  c ; 


tf  =  fopen  (training Jile,  "r”) ; 

(scant  (tf,  "%d",  inumjworda)  ; 
for  (i  =  0 ;  i  <  num_words ;  i+  +) 

(scant  (tf,  “%e'\  word_number[i]) ; 
fcloae  (tf) ; 
wordcounter  =  0 ; 

(net  =  fopen  (first _net  file,  "r")  ; 

fscanf  (fnet,"%d  %d  %d ",  i^ysize,  ifjtsize,  &f_number_inputa) 
for  (r  =  0  ;  r  <  f_ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  f_xsize  ;  c+  +)  { 

for  (i  =  0  ;  i  <  f_number_inputa  ,  i+  +)  { 

fscanf  (fret,"  %f",  if  mapir][c][i]) ; 

} 

> 

> 

fcloee  (fnet)  ; 


getin  0 

{ 


if  (word_courrter  =  =  num_words) 
word_counter  =  0 ; 
read_word  (word_counter) ; 
word  counter +  +  ; 


get  rrtd  in  Q 

i 

int 
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double 

max_rand  =  pow  (2.0, 31.0)  - 1.0 ; 

int 

pointer ; 

pointer 

=  floor  ((randQ  *  (num_word*  -  .0001)  /  max_rand)) 

> 

read_word  (pointer)  ; 

weightem  (map) 

{ 

float 

map  [20]  [20]  [225]  ; 

Int 

nright  nleft  nup,  ndown,  r ,  c,  i ; 

if  (neigh[0]  >  0  &&  neigh[l]  >  0)  { 

might  =  closest[0]  +  n*igh[0]  - 1 ; 
if  (nright  >  =  xsize) 

nright  =  xsize  - 1  ; 
nfeft  =  closest[0]  ■  neigh{0]  +  1  ; 
if  (nieft  <  0) 

nleft  =  0 ; 

nup  =  closest[1]  -  neigh[1]  +  1  ; 
if  (nup  <  0) 

nup  =  0 ; 

ndown  =  cloeest[1]  +  neigh[1]  - 1  ; 
if  (ndown  >  =  /size) 

ndown  =  ysiz*  - 1  ; 

} 

else  { 

nright  =  ciosest(0]  ; 
nleft  =  closest [0] ; 
nup  =  closest!  1] ; 
ndown  =  closest(l)  ; 

> 

for  (r  =  nup;  r  <  =  ndown  ;  r+  +)  { 

for  (c  =  nleft ;  c  <  =  nright ;  c+  +)  ( 

for  (i  =  0  ;  i  <  number Jnputs  ;  i++) 

map[r][c][i]  +=  gain  *  (input[ij  -  map[r][c] [i])  ; 

> 


pointer  ; 

flag,  r,  c,  i,  j,  k  ; 
in(16],  dl,  d2,  d3,  d4,  d5  ; 
element ; 

Ioc2(2000](2],  Ioc3[2000]  [2]  ; 
*fsnd ; 

sound,  point,  x[5],  y[5] ; 
max_pta  ; 
max ; 


read_word  (pointer) 
int 

{ 

int 

double 

float 

int 

FILE 

int 

int 

double 


for  (i  =  0  ;  i  <  number  Jnputs  ;  i+  +) 
input[i)  =  0.0 ; 

tend  =  fopen  (word_numb*r[pointer),  "r")  ; 
sound  =  0 ; 
i  =  0; 

flag  =  0 ; 


twop*c4b 
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twoptc4b 


white  (lleg  1=  1)  { 

fscanf  (fend,  "%f\  &element) ; 
if  (feof(fend)  !=0) 
deg  3  1 ; 
etee  if  (i  >  98) 

dag  =  i ; 

eiee  { 

in[i]  =  (double)  element ; 
i++  ; 

> 

«((i==15)&A(dag==0)){ 

f  mindiet  (f  map,  in,  Aloc2[eound][0})  ; 
i  =  0; 
sound +  +  ; 

} 

} 

fcloee  (fend) ; 

for  (i  =  0  ;  i  <  sound  ;  i+  +)  ( 

Ioc3[i)l0]  =  Ioc2[i][0]  ; 
loc3[il(1)  =  loc2[i](1]  ; 

} 

max_pts  =  sound  ; 

...  Trajectory  Reduction ... 

for  (i  =  0  ;  i  <  j ;  i  +  +)  { 

point  =  1  +  ioc2[i][0]  +  loc2[i][l]  *  f_xaize  ; 
input[i]  =  point  I  226.0  ; 

} 


fjnindist  (f_map,  inp,  close) 


double 

inp(16]  ; 

int 

close [2]  ; 

float 

f_map[20][20][i6]  ; 

int 

r,  c,  i ; 

double 

dist ; 

double 

minimum  =  99999.9 

for  (r  =  0  ;  r  < 

f_ys«e  ,  r+  +)  { 

for  (c  =  0  ;  c  <  f_xsize  ;  c+  +)  { 
dist  =  6.0 ; 

for  (i  =  0  ;  i  <  f_number_inputs  ;  i++) 

diet  +  =  pow  (inp(ij  -f_map[r][c][i],  2.0) ; 
if  (dist  <  minimum)  { 

minimum  =  dist ; 
close{0]  =  c  ; 
ciose[1j  =  r  ; 

> 
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$  link  twopic8,nwin6, option*  file/ opt 

r 

*********************************  twopicfl.c  *•«*****•******************< 

Thee*  routine*  find  the  cloeeet  digit,  from  a  specified  (usually  non¬ 
training)  set  of  digits,  to  each  node  in  a  second  Kohonen  net. 

This  is  used  to  identify  node*  for  later  uae  of  the  net  in  recognizing 
unknown  digits. 

Inputs  to  the  net  are  100  point  scalar  (1-225)  trajectories  filled 
with  trailing  O  s. 

The  'closest'  process  uses  DTWfmaskQ.lengthQ)  distance. 


*1 

#  include  math 

#  include  stdio 

#  include  time 


float  map[20][20][225] ;  /*  output  nodes  */ 

double  input[225] ;  /*  input  nodes  */ 

double  nod#_dist ; 


int  closest[2] ;  /*  closest  nod*  •/ 

int  xsize,  ysiz*  ;  /*  Size  of  array  */ 

int  number Jnputa  ; 


char  training_file[30],  temp_file[30],  first_net_file(30]  ; 

char  ne*Jile[30]  ; 


extern  int 

int 

int 

float 

float 

extern  int 


num  words  ; 
mask  [20]  [20]  ; 
map2[20][20][100][2]  ; 
aa  =  0.75  ; 
bb  =  0.75 ; 
f_xslze,  f_yaiza ; 


extern  int  location[2000][2] ; 

int  innput[200][100][2]  ; 

extern  int  l*ngth[200]  ; 

extern  char  word_numb*r[200][15]  , 


mindist  (r,  c,  close) 
int 
int 

{ 

int 

double 

double 


r.  c  ; 

•close ; 

sound ; 
dist ; 

minimum  =  9.99*31  ; 


for  (sound  =  0  ;  sound  <  num_words  ;  sound-*-  -*-)  { 

dtw  (&map2[r][c][0][0].  &innput[sound]{o}[0],  mask[r][c], 
I  length  [sound],  &dist)  ; 

if  (dist  <  minimum)  { 

minimum  =  dist ; 

•close  =  sound ; 

} 

nod*  dist  =  minimum  ; 
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mein  0 

{ 

int  c ; 

prirrtf  ('\nTWOPtC8  (Give*  cloeeet  word  for  each  node:  100  wt*)..An”) 
map  speech  0  ; 

> 


map  speech  0 

{ 

int 

r.  c,  i,  j,  k  ; 

char 

nam*_trj[30],  temp[30] 

int 

loc ; 

FILE 

•fnet,  *flog,  *fmask ; 

prirrtf  ("\nEnter  name  of  pre-processor  Koh  net-file  [less  net],  ")  ; 

scanf  (“%s",  temp) ; 

sprintf  (first_net_file,  “%s.net”,  temp)  ; 

printf  (“Enter  name  of  header  file  containing  words  (less  h dr):  ") ; 

scanf  ("%e“,  temp_file) ; 

sprintf  (trainingjile,  “%s.hdr",  tempjile) , 

printf  ("Enter  name  of  output  Koh  net_file  [less  net]:  ")  ; 

scanf  tempjile) ; 

sprintf  (net_file,  '”%a.net",  temp_fiie)  ; 

sprintf  (temp,  “%smsk“,  tempjile)  ; 

fnet  =  fopen  (netfile,  "r")  ; 

fscanf  (fnet.”%d  %d  %d",  &ysize,  &xsize,  &number_inputs) ; 
for  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  xsize  :  c+  +)  { 

for  (i  =  0  ;  i  <  numberjnputs  ;  i+  +)  { 

fscanf  (fnet."  %f",  &map[r][c][i])  ; 

} 

} 

> 

fclose  (fnet)  ; 

readjm  Jile  0  ; 

fmask  =  fopen  (temp,  "r")  ; 
for  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

for  (c  =  0 :  c  <  xsize  ;  c+  +)  { 

fscanf  (fmask, "%d",  &mask[r][c])  ; 

> 

> 

fclose  (fmask) ; 


flog  =  fopen  ('1emp.log'”, "w")  ; 

fprintf  (flog,  “TWOPIC8:  %s\n",  name_trj)  ; 

fprintf  (flog,  "•>  %s  ->  %s  ->\n“,  first_net_file,  net_file) ; 

fprintf  (flog,  "Size  is  %d  by  %d  nodes\n",  xsize,  ysize) ; 

printf  ("\nExpect  %d  calculationsAn ",  num_words)  ; 
fprintf  (flog,  "Expect  %d  calculationsAn",  num_words)  ; 
printf  (“VnReading  word:  ")  ; 
for  (r  =  0  ;  r  <  num_words  ;  r+  +)  { 
printf  ("%d  ",  r) ; 
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getin  0  ; 

for  (c  =  0 ;  c  <  number Jnputs  ;  c+  +)  { 
innput[r][c][0]  =  location  [c][0] ; 
innput[r][cj[ij  =  (ocatton[c][lj ; 

} 

> 

printf  ("\n")  ; 

for  (r  =  0  ;  r  <  yaize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  xaize  ;  c+  +)  { 
mindiat  (r,  e,  &ioc) ; 
k  =  c  +  r  •  xaize  ; 

printf  ('AnNode  %3d  :  word  #  %3d,  diat  =  %le  ", 
k,  loc,  node_diat) ; 
printf  (“(%*)",  word_number[loc])  ; 
fprintf  (flog,  'AnNode  %3d  .  word  #  %3d,  diat  =  %ie  ", 
k,  loc,  noda_di*t) ; 

fprintf  (flog,  "(%«)",  word  number[loc])  ; 

> 

} 

printf  OnCaiculationa  finishedAn")  ; 
fclose  (flog)  ; 

} 

dtw  (template,  utterance,  tjength,  ujength,  ave  dist) 
int  template[200]  [2]  ,~utterance(200]  [2]  ; 

int  tjength,  ujength  ; 

double  ‘ave  dist ; 

{ 

float  back_path[2]  [200]  ; 

int  b _p[2]  [200] ; 

int  r,  c  ; 

int  ptr,  b  ptr  ; 

float  dl,  d2,  d3,  diet ; 

dist  =  0.0 ; 
b_ptr  =  1  ; 

b_p(0](0]  =  1  ; 

for  (r  =  1  ;  r  <  tjength  ;  r+  +) 

b_p[0](r]  =  b_p[Q](r-11  +  1  : 
for  (r  =  0  ;  r  <  tjength  ;  r+  +)  { 

back_path[0][r)  =  (dist  +  =  bb  *  ( 

abs(utterance[0](0]  -  template[r][0))  +• 
abs(utterance(0][lj  -template[rj(i])))  ; 

} 

for  (c  =  1  ;  c  <  u_length  ;  c  +  +)  { 
if  (b_ptr  =  =0)  { 

b_ptr  =  1  ; 
ptr  =  0  ; 

> 

else  { 

b_ptr  =  0 ; 
ptr  =  1  ; 

> 

for  (r  =  0  .  r  <  tjength  ;  r+  +)  { 

dist  =  abs(utterance[c][0]  -  template[rJ[0J)  + 
abe(utterance[c)[i]  -  template[r][1])  ; 
if(r==0){ 

back_path(ptr)(r)  =  back  _path[b _ptr)(r]  + 
(aa  *  diat)  ; 

b_p(ptr)(r)  =  b_p[b_ptr][r)  +  1  ; 
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> 

eiae  { 

dl  =  back_path[b_ptr][r-1]  +  diet ; 
d2  -  beck _path[ptr][r-1]  +  (bb  •  diet) ; 
d3  =  back_path[b _ptr][r]  +  (a*  *  diat) ; 
if  (d2  <  =  d3  &&  d2  <  d1){ 

b*ck_path[ptr][r]  =  d2 ; 
b_P{P<r]M  =  t>_p(ptr]{r-1]  +  1  ; 

> 

eiae  H  (d3  <  =  d2  &&  d3  <  dl)  { 
back_path[ptr][r]  =  d3 ; 
b_P(frt '■]['■]  =  b_p[bj3ir)[r]  +■  1  ; 

> 

ala*  { 

b*ck_path[ptr][r]  =  dl  ; 
b_p[ptr][r]  =  b_p[b_ptr][r-1]  +  1  ; 
} 

} 

} 

} 

*ave  diat  =  back_path[ptr][t  length-1]  /  b _p[ptr][t  length-1] ; 

} 


nwin6.c  *»*»••»»»»*»•**»»»»»»»»»»•»»*< 

Those  routines  support  TWOPIC8  C/EXE  in  finding  the  closest  digit 
to  each  node  in  a  second  Kohonen  net. 

Inputs  are  100  point  scalar  (1-225)  trajectories  filled  with 
trailing  O  s. 

The  distance  routine  in  DTW(mosk[]  JengthQ). 


Q.  BarmoraGS  Aug  88 


#  include  math 

#  include  stdio 

#  include  stat 

extern  double 

input[22S]  ;  /*  input  nodes  */ 

extern  double 

gain  ; 

extern  int 

closeet[2]  ;  /*  closest  node  */ 

extern  int 

neigh(2] ;  /*  neighbor  */ 

extern  int 

xsize,  ysize  ;  /•  Size  of  array  */ 

extern  int 

numberjnputs  ; 

extern  int 

train_discrete  ; 

extern  char 

training_file(30]  ; 

extern  char 

first_net_file(30]  ; 

int 

number_discretes ; 

int 

word_counter ; 

int 

num_words ; 

char 

word_number[200]  [  1 5]  ; 

int 

length  [200]  ; 

int 

f_y8ize,  f  xsize,  f  numberjnputs  ; 

float 

f_map[20]  [20]  [  1 6] ; 
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int 

extern  int 
extern  float 


read  tm  file  0 

{ 

FILE 

int 


location[2000][2] ; 
map2(20][20][100][2]  ; 
map[20]  [20]  [22S]  ; 


*tf,  *fnet ; 
i,  r,  c,  k,  temp  ; 


tf  =  (open  (training_file,  “r") ; 
facanf  (tf,  "%d",  4num_worda)  ; 
for  (i  =  0  ;  i  <  num_worda ;  i+  +) 

facanf  (tf,  “%*' ",  word_number[iJ)  ; 
fcloee  (tf) ; 
word_counter  =  0 ; 

fnet  =  fopen  (firat_net_file,  “r”)  ; 

facanf  (fnet,"%d  %d  %d",  4f_yaize,  4f_xai2*,  4f_number_inputa) ; 
for  (r  =  0  ,  r  <  f_ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  f_xsize  ;  c+  +)  { 

for  (i  =  0  ;  i  <  f_number_inputa  ;  i+  +)  { 

facanf  (fnet,"  %if",  4f  map(r][cl(i)) ; 

> 

} 

> 

fclose  (fnet)  . 

for  (r  =  0  ;  r  <  ysize  ,  r+  +)  { 

for  (c  =  0  ;  c  <  xaize  ;  c+  +)  { 

for  (i  =  0  ;  i  <  number Jnput*  ;  i  +  +  )  { 

temp  =  (int)  !map(r](c](i]  *  226.0  - 1.0) 
k  =  temp  %  f_xsize  , 
map2[r][c)[i](l)  =  (temp  •  k)  /  1_x*iz*  , 
map2[r](c](i](0J  =  k ; 

> 


> 

getin  0 

{ 


} 


} 


if  (word_counter  =  =  num_words) 
word_counter  =  0 ; 
read_word  (word_counter)  ; 
word  counter ++  ; 


get  rnd  in  0 

{ 


int 

double 

int 


i ; 

max_rand  =  pow  (2.0.  31.0)  - 1.0  ; 
pointer ; 


} 


pointer  =  floor  ((randQ  *  (num_ words  -  .0001)  /  max_rand)) ; 
read_word  (pointer)  ; 


readjMord  (pointer) 
int 

{ 


pointer ; 
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ini  flag,  r,  c,  i,  j,  k  ; 

doubt*  in[16],  dl,  d2,  d3,  d4,  d5  ; 

float  element  ; 

irrt  Ioc2[2000][2],  k>c3[2000][2] ; 

FILE  *fend ; 

i n»  sound,  point,  x(5],  y[5] , 

irrt  maxjrta ; 

doubt*  max ; 

fend  =  fopen  (word_numb*r[point*r],  "r") ; 

sound  =  0 ; 

i  =  0; 

flag  =  0 ; 

while  (flag  !=  1)  { 

(scant  (fend,  “%f ^element)  ; 
it  (foot (tend)  !  =0) 
flag  =  1  ; 
else  if  (i  >  99) 

flag  =  1  ; 

els*  { 

in[i]  =  (doubt*)  element ; 
i++  ; 

> 

it  ((i  =  =  15)  &&  (flag  =  =  0))  { 

f  mindist  (f  map,  in,  &loc2[sound][0})  ; 
i“=  0 ; 
sound  +  +  ; 

> 

} 

(close  (fend)  ; 

for  (i  =  0  ;  i  <  sound  ;  i  +■  +)  { 

Ioc3(i][0)  =  Ioc2{i](0)  , 
loc3[i](1]  =  loc2[i][1]  ; 

} 

maxjjta  =  sound ; 

...  Trajectory  Reduction  ... 

for  (i  =  0  ;  i  <  j  ;  i++)  { 

location[i][0]  =  Ioc2(i][0]  ; 
location(i][1]  =  loc2[i](1]  ; 

length(pointer)  =  j ; 
for  (i  =  j ;  i  <  2000  ;  i++) 

location[i](1]  =  (location [i][0]  =  0)  ; 


i  mindiat  (f_map,  inp,  close) 

double  inp[16] ; 

int  clos«(2]  ; 

float  f  map[20][20][16]  ; 

< 

int  r,  c,  i ; 

double  diet ; 

double  minimum  =  99999.9  ; 

for  (r  =  0  ,  r  <  f_yslze  ;  r+  +)  ( 

for  (e  =  0  ;  c  <  f_xsiz*  ;  c+  +)  { 
diet  =  6.0 ; 
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for  (i  =  0  ;  i  <  f_number_input»  ;  i+  +) 

diet  +  =  pow  (inp{i|  -  f_map[r)lc][i],  2.0)  ; 
if  (di8t  <  minimum)  { 

minimum  =  diet ; 
cloee[0]  =  c  ; 
ctoee(lj  =  r ; 

} 
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outdat4 


> 


> 


» 


I 


I 


I 


» 


I 


$  link  outdat4, options  file/opt 

/* 

HMtMUIMMMtMMttMMMmM  0Utd«t4.C  ***»»»«»*•**•*«••*••** 

This  routine  creates  a  *.dal  file  containing  stored  trajectories 
to  train  second  Kohonen  nets. 

Trajectoriee  are  100  x-y  pairs  filled  with  trailing  -Vs. 


V 

#  include  math 

#  include  stdio 

#  include  time 


Capt  Gary  i  armors,  2  Sep  88 


float  map[20][20][225]  ;  /*  output  nodes  */ 

double  input[22S]  ;  /*  input  nodes  */ 


int  xsize,  ysize  ;  /*  Size  of  array  */ 

int  numberjnputs ; 


char 

char 

char 

double 

int 

int 

int 

char 

int 

float 

int 


training _file[30],  net_file[30],  first_net_file[30]  ; 
temp_file[15]  ; 
net_name[15]  ; 

innput[100][100]  J*  input  vectors  */ 
number  discretes  ; 
word_counter ; 
num_words  ; 
word_number[  1 00]  [  1 5]  ; 
t_ysize,  t_xsize,  f  number  inputs  ; 
f_map[20][20][16]  ; 
iocation[2000][2]  ; 


mindist  (map,  inp,  close) 
double 
int 
float 

{ 

int 

double 

double 


inp[225]  ; 
close[2]  ; 

map[20j  [20]  (2251  : 

r,  c,  i ; 

diat  i 

minimum  -  9  9e3l  ; 


for  (r  =  0  ;  r  <  ysize  ;  r+  f)  { 

for  (c  =  0  ;  c  <  xsize  ;  c  +  +)  { 
dist  =  0.0  , 

for  (i  =  0  ;  i  <  numberjnputs  ,  i+  +) 

dist  +=  pow  (inp(i]  -  map[r](c](i],  2.0)  ; 
if  (dist  <  minimum)  { 

minimum  =  dist  ; 
close(0]  =  c  , 
clo8e[1]  =  r , 

> 


userinp  0 

{ 
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outdata 


int  line ; 

int  c ; 

struct  tm  ‘localtimeO,  'time  ; 

int  *bintim  ; 


do  { 

print!  (“OUTDAT4:  Prepare  training  data  [x,y],  second  kohonen...  \n\n")  ; 

print!  ("Enter  name  o!  header  file  containing  words  (lees  hdr):  ") ; 

scan!  (“%e",  temp  fiie)  ; 

sprint!  (trainingjile,  "%e.hdr",  temp_file)  ; 

number Jnpute  =  100  ; 

print!  (“Enter  name  of  pre-processor  Kohonen  net  file  [less  net]:  ") ; 

scan!  (“%s",  net_name) ; 

sprintf  (first_net_file,  “^is.net",  net_name) ; 

printf("Enter  name  of  data  file  to  create  [less  .dart]:  ") ; 

scan!  (“%s",  net_name)  ; 

sprint!  (net_file,  “%s.dat",  net_name)  ; 

printf(“Ready  to  begin?  (y/n) ") ; 

while  ((c  =  gate  (stdin))  =  =  ' '  1 1  c  =  =  "Vn"  1 1  c  =  =  Af) 


mainO 

{ 

extern  unsigned  _stklen  ; 
_stklen  =  8192  ; 


userinp  0  ;  /*  Get  input  values  V 
print!  ("\n'T  ; 
read_tm_file  0  ; 

printf  ("\n.DAT  file:  %a  saved!\n",  net  file)  : 

} 

read  trn  file  0 

{ 

FILE  *tf.  *fnet ; 

int  j,  i,  r,  c  ; 

tf  =  fopen  (trainingjile,  "r")  ; 
fscanf  (tf.  “%d",  Anum_ words)  , 
for  (i  =  0  ;  i  <  num_words  .  i+  +) 

fscanf  (tf,  "%8",  word_number[i])  , 
fclose  (tf)  ; 

fnet  =  fopen  (first_netjile,  "r")  ; 

fscanf  (tnet,"%d  %d  %d".  &f_ysize,  &f_xsize,  &f_number_inputs) ; 
for  (r  =  0  ;  r  <  f_ysize  :  r+  +)  { 

for  (c  =  0  ;  c  <  f_xstze  ;  c+  +)  { 

for  (i  =  0  ;  i  <  f_number_inputs  ,!+•*•){ 

fscanf  (fnet,"  %f",  &f  map[r][c][i])  ; 

> 

> 

> 

fclose  (fnet) : 
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out  0^4 


fnet  =  toper  (netjlle,  "w") ; 
fprintf  (fnet,  •%d\n'\  num_worde) , 
for  (i  *  0 ;  i  <  num  words  ;i++)  { 
printf  <"  %d",  Q  ; 
readword  (9  ; 

for  (j  =  0 ;  j  <  number Jnpute  ;  j+ 1)  { 
fprintf  (fnet,  ,:%d  %d\n", 

k>cetionlj][0],  location  [j](1])  ; 

> 

> 

fcloee  (fnet)  ; 


readword  (pointer) 


int 

pointer ; 

int 

flag,  r.  c.  i,  j,  k  ; 

double 

in[16],  dl,  d2,  d3,  d4,  d5  , 

float 

element ; 

int 

Ioc2(2000][2],  Ioc3[2000)  [2] 

FILE 

•fsnd , 

int 

sound,  point,  x[5],  y{5]  ; 

int 

maxpts  ; 

double 

max ; 

fsnd  =  fopen 
sound  =  0 ; 

(word_number[pointer],  “r")  ; 

1  =  0; 

flag  =  0 ; 
while  (flag  !  = 

1){ 

fscarrf  (fsnd,  “%f",  A  element)  ; 
if  (feof (fsnd)  !  =0) 
flag  =  1  ; 
else  if  (i  >  99) 

flag  =  1  ; 

else  { 

in[i)  =  (double)  element ; 
i+  +  ; 

> 

»  ««  ==  15)  &&  (flag  ==  0)>  { 

f  mindist  (f  map,  in,  &loc2[sound](0J) , 
i”=  0 ; 
sound+  +  ; 

> 

> 

fcloee  (fsnd)  ; 

for  (i  =  0  ;  i  <  sound  ;  i+  +)  { 

Ioc3(i][0]  =  Ioc2(i][0] ; 
loc3[i](1J  =  loc2[i]{1] ; 

> 

maxjjts  =  sound  ; 

...  Trajectory  Reduction  ... 

for  (I  =  0  ;  I  <  j ;  I++)  { 

location[i)(OJ  =  Ioc2[i](0]  ; 
locationiijjlj  =  loc2[i][1) ; 

> 


B-127 


Appendix  B:  Computer  Programe 
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tor  (i  =  ) ;  i  <  numberjnpuU  ;  i+  +) 

location(i][of  =  (Iocetion{i3{1]  =  -1)  ; 

> 


f_mindiet  (t_mep,  inp,  cloee) 


double 

inp[16]  ; 

int 

cloae(2] ; 

float 

f_map[20]  [20]  [  1 6]  ; 

int 

r.  c,  i ; 

double 

diet ; 

double 

minimum  =  99999.9 ; 

for  (r  =  0 

;  r  <  f_ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  f_xsize  ;  c  +  +)  { 
diet  =  0.0 ; 

for  (i  =  0  ;  i  <  f_numberjnput»  ;  i+  +) 

diet  +=  pow  (inp[i)  ■  f_map{rj[c][i],  2.0)  ; 
if  (diet  <  minimum)  { 

minimum  =  diet ; 
cloeefO]  =  c ; 
cloeejl]  =  r . 

} 
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mnMnHHmMMtMu  tWObas4.C  •••••*••••••••••«•«*••*• 

Routine  to  train  a  second  Kohonen  net  using  stored  trajectories 
in  a  *.dat  We  (created  with  OUTDAT4.EXE). 

Trajectories  are  100  x-y  pairs  filled  with  trailing  -1.  This 
version  includes  conscience. 


Capt  Gary  Barmore,  7  Sep  88 
V 

#  include  math 

#  include  stdio 

#  include  time 

int 
int 

double 
float 
double 
double 
double 
double 
double 
double 

int 
int 
int 
int 
long 
int 
int 
int 
int 
int 
int 
int 
int 

char 
char 

char 

struct  curve  { 


int 

type; 

double 

maxgain  ; 

double 

mingain  ; 

double 

midgain  ; 

int 

midtime  ; 

}  gcurve 

• 

struct  fig  { 

int 

mdjn ; 

>  teg  . 

extern  int 

word  counter ; 

extern  double 

innput[100][100][2] 

int 

f_xsize,  f_ysize  ; 

conscience [20]  [20]  j*  records  #  times  closest  *1 

nodes  ;  /*  number  of  nodes  V 

consc  =  1.1  ;  /*  conscience  factor  */ 

map(20]  [20]  [1 00]  [2]  ;  /*  output  nodes  */ 

mput[l00](2] ;  /*  input  nodes  */ 

gain,  noise ; 

mcount ; 

percent ; 

xoff  =  0.0  ; 

yoff  =  0.0 ; 

closest(2] ;  /*  closest  node  */ 

neigh[2) ;  /*  neighbor  */ 

nrangex,  nrangey  ;  /*  neighbor  range  */ 

nfactorx,  nfactory  ,  /*  neighbor  factor  */ 

count ;  /*  #  of  iterations  */ 

graph  ;  /•  #  between  plots  */ 

seed  ; 

maxneighx,  maxneighy  ;  /*  Starting  area  */ 
minneighx,  minneighy  ;  /*  Final  area  */ 
xsize,  ysize  ;  /*  Size  of  array  */ 
numberjnputs  ; 
wrap_flag  =  0 ; 
train_flag,  train_discrete  ; 

training_file[30],  net_file(30],  first_net_file[30]  , 
temp_file[151 ; 
net_name(15] ; 
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float  map[20]  [20]  [  1 00]  [2]  ; 

{ 

int  r,  e,  i ; 

float  max_rand  =  pow(20,  310)  - 1.0 ; 

node*  =  y  size  *  xsize  ; 
for  (r  =  0  ;  r  <  yaize ;  r+  +)  { 

for  (c  =  0  ,  c  <  xsize ;  c+  +)  { 
conacience[r][c]  =  0 ; 
for  (i  =  0 ;  i  <  number Jnputa  ;»++){ 

map[r][c][i][0]  =  f_xsize*(rand  0  /  max_rand)  ; 
mep(rlici(iiil]  =  f_yeize*(rand  0  /  max  rand) ; 
> 

> 


inp[100](2]  ; 
close[2]  ; 
its ; 

r,  c,  i  ; 
dist ; 

minimum  =  999*31  ; 

for  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

for  (c  =  0  ;  e  <  xsize  ;  c+  +)  { 
dist  =  0.0 ; 

if  (conscience[r][c]  <  consc  *  its  /  nodes )  { 
for  (i  =  0  ,  i  <  numberjnputs  ,  i  +  +) 

dist+  =faba(inp[i][0)-map[r]  [c][i)[0])  + 
fabs(inp[i)[1]-msp[r][c][i)[1]); 
if  (dist  <  minimum)  { 

minimum  =  dist ; 
closefO)  =  c  , 
ciosa[lj  =  r ; 

} 

> 

} 

> 

conscience[close{1]][clo8e[0]]  +  =  1  ; 

> 

userinp  0 

{ 

int  line ; 

int  c ; 

do  { 

printf  (  "TWOBAS4  Train  2nd  Koh  with  2-D  trajectoriaa  ...  \n\n")  ; 
f_xsiza  =  (f_ysi z*  =  15)  ; 


mindist  (inp,  close,  its) 
double 
int 
long 

{ 

int 

double 

double 


printf  ("Enter  conscience  factor  (>  1.0):  [float]  ")  : 
scan!  ("%r,  &  consc) ; 
if  (consc  <  1.0) 

consc  =  1.5 : 

printf("Enter  size 'm  n'  (for  an  m  x  n)  of  array  =  ?  [int  int]  ") ; 
scarrt("%d  %d",  &ysize,  &xsize)  ; 


B-130 


Appendix  B:  Computer  Program* 


twobaeS 


M  (y size  <  2) 

yetze  =  2 ; 
else  it  (yeize  >  20) 

yaize  =  20 ; 
if  (xsize  <  2) 

xsize  =  2 ; 

•fee  if  (xsize  >  20) 

x*<zs  =  20 ; 

printf  ("Do  you  want  0)  sequential  training, \n") ; 
printf  (“  1)  randomized  training?  ") ; 
ecanf  (“%d”,  &flag.md_in) ; 

train_discrete  =  1  ; 
number  Jnputa  *  100  ; 

printf('  Enter  name  of  training  file  [less  .dat]:  ") ; 

scant  (“%*”,  net_name)  ; 

sprintf  (trainingjiie,  "%s.dat",  net_name)  ; 

printfC'Enter  name  of  net  file  to  create  [less  net]:  ")  ; 

scant  ("%*”,  net_name) ; 

sprintf  (net_file,  "%e.net",  net_name)  ; 

printf  ("Number  of  iterations  =  ?  [int]  ")  ; 
scant  (“%ld",  &count)  ; 
if  (count  <  =  10  ||  count  >  200000) 
count  =  100  ; 
mcount  =  (double)  count ; 

printf  ("Number  of  iterations  between  status  messages  =  ?  [int]  ") ; 
scant  ("%d".  &graph)  , 
if  (graph  <  1  1 1  graph  >  count) 
graph  =  10  ; 


ingain  0  ; 

printf  (“Starting  size  of  neighborhoods  “yn  xn'  =  ?  [int  int]  ") ; 
scant  (“%d  %d",  &maxneighy,  &maxneighx)  ; 
if  (maxneighx  <  2  1 1  maxneighx  >  xsize  •  1) 
maxneighx  =  2 ; 

if  (maxneighy  <  2  1 1  maxneighy  >  ysize  •  1) 
maxneighy  =  2 ; 

printf  (“Final  size  of  neighborhoods  ‘yn  xn’  =  ?  [int  int]  ") ; 
scant  (“%d  %d",  &minneighy,  &minneighx)  ; 
if  (minneighx  <  1  1 1  minneighx  >  maxneighx) 
minneighx  =  1  ; 

if  (minneighy  <  1  1 1  minneighy  >  maxneighy) 
minnetghy  =  1  ; 


printf  (“InitiaU  seed  for  random  #  generator  =  ?  [int]  "); 
scant  ('“%d",  &seed) ; 
if  (seed  =  =  0)  { 

seed  =  138 ; 

} 

srand  (seed)  ; 
wrap_flag  =  0 : 
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« 


m 


9 


> 

ingain  0 

{ 

inf 


printf("Ready  to  begin?  (y/n)  ") ; 

while  ((c  =  gate  (etdin))  =  =  ' 1 1 1  c  =  =  \n'  1 1  c  =  =  M) 

}  while  (c  !  =  y) ; 


line ; 


printf(“For  gain  enter  0)  UNEAR,  1)  SIGMOIDAL,  2)  PIECEWISE  UNEAR  :  "); 
scent  ("%d",  Agcurve.type) ; 

if  (gcurve.type  =  =  0  1 1  gcurve.type  =  =  1)  { 
printf  ("Maximum  gain  =  ?  (float)  ") ; 
scant  (“%E",  A  gcurve.maxgain) ; 
if  (gcurve.maxgain  >=  1.0  1 1  gcurve.maxgain  <  =  0  0) 
gcurve.maxgain  =  96 ; 

printf  ("Minimum  gain  =  ?  (float)  ")  ; 
scant  ("%E",  Agcurve.mingain)  ; 
if  (gcurve.mingain  <  =  0.0  1 1  gcurve.mingain  >  =  1.0) 
gcurve.mingain  =  0.0 ; 

> 

else  { 

printf  ("First  segment  starting  gain  =  ?  (float)  ”) ; 
scant  ("%E",  &  gcurve.maxgain)  ; 
if  (gcurve.maxgain  >=  1.0  1 1  gcurve.maxgain  <  =  0.0) 
gcurve.maxgain  =  99 ; 

printf  ("Second  segment  starting  gain  =  ?  (float)  ”)  ; 
scanf  ("%E",  Agcurve  midgain)  ; 
if  (gcurve.midgain  <=  0.0  1 1  gcurve. midgain  >=  1.0) 
gcurve.midgain  =  0.0  ; 

printf  ("Second  segment  starting  iteration  =  ?  (float)  ")  ; 
scant  ("%d",  Agcurve. midtime) ; 
if  (gcurve.midtime  <  =  0  1 1  gcurve. midtime  >  count) 
gcurve.  midtime  =  count  /  2  ; 

gcurve.mingain  =  0.0 ; 

> 


getgain  (0 

long 

{ 


if  (gcurve.type  =  =  0) 

gain  =  (percent  *  (gcurve.maxgain  -  gcurve.mingain))  + 
gcurve.mingain  ; 
else  if  (gcurve  type  =  =  1) 

gain  =  0.9  *  (gcurve.maxgain  -  gcurve.mingain)  /  (1 .0  +  exp  (i  - 
count  /  2.0))  +  .1  ; 

else  { 

if  (i  <  gcurve.midtime) 

gain  =  gcurve.maxgain  *  (1.0-  (double)  i  /  gcurve.midtime)  ; 

else 

gain  =  gcurve.midgain  *  (1 .0  -  (double)  i  /  count) ; 


« 
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{ 


} 


0 


int 

f.  c,  i,  x.  y  ; 

FILE 

•fnet ; 

float 

rem_x,  rem_y 

fnet  =  fopen(net_file,"w ")  ; 

fprintf  (fnet,”%d  %d  %d“,  yaize,  xsize,  number  inputs)  ; 
for  (r  =  0 ;  r  <  ysize ;  r+  +)  { 

for  (c  =  0  ;  c  <  xsize  ;  c+  +)  { 

for  (i  =  0  ;  i  <  number  inputs  ;  i-M-)  { 
x  =  map[r][cj[i][0)  ; 
rem_x  =  map[r][c][i][0]  -  x  ; 
y  =  map[r](c|[i][1]  ; 
rem_y  =  map[rl[c](i][1]  -  y  ; 
if  (rem_x  >  0.49) 
x++  ; 

else  if  (rem_x  <  -0.49) 

X —  ; 

if  (rem_y  >  0.49) 
y  +  +  ; 

sise  if  (rem_y  <  -0.49) 

y-. 

if  {x  <  -1) 

x  =  -1  ; 

else  it  (x  >  =  f_xsize) 

x  =  f  xsize  - 1  ; 

if  (y  <  -1) 

y  =  -1  ; 

else  if  (y  >  =  f_ysize) 

y  =  fjysize  - 1  ; 
fprintf  (fnet,''  %d  %d ",  x,  y) ; 

> 

> 

} 

fcloee  (fnet)  , 


mainO 

{ 

long 

char 

irrt 

int 

FILE 


si (10]  ; 
wsjd  =  1  ; 
clear  flag  =  1; 
*tf ;  “ 

_stklen  ; 


extern  unsigned 


jstklen  =  8198  ; 

userinp  0  ;  /*  Get  input  values  */ 
nfactorx  =  maxneighx  -  minneighx  +  1  ; 
nfactory  =  maxneigby  •  minneighy  +  1  ; 
init  (map)  ;  /*  Initialize  weights  */ 
read_tm_file  0  ; 


for  (i  = 


;  i  <  =  count ;  i+  +)  { 
if  (i  %  graph  =  =  0)  { 

printf  (  TWOBAS4:  gain  =  %f,  yrange  =  %d,  ", 
gain,  nrangey) ; 

printf  (“xrange  =  %d,  iteration  #  %d",  nrangex.i)  ; 
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printf  (“  (o(  %ld)\n ",  count) ; 
it  (access  (net_fils,0)  ==  0) 
delete  (nstjile) ; 
save  nat  0  ; 

> 

percent  =  (mcount  -  i)  /  mcount ; 
gatgain  (i) ; 
if  (flag.mdjn  =  =  0) 
gatin  0 ; 

aiaa 

gat_md_in  0  ; 

mindiat  (Ainnput [word_courrter]  [0]  [0] ,  cloaaat,  i) ; 
if  (gcurva.typs  1=  2)  { 

nrangax  =  minneighx  +  parcant  *  rrfactorx  ; 
nrangay  =  minnaighy  +  parcant  *  nfactory  ; 

i 

aiaa  if  (i  <  gcurva.midtima)  { 

nrangax  =  minneighx  +  rrfactorx  * 
((double)(gcurve.midtime  -  i))  /  gcurva.midtima  ; 
nrangay  =  minnaighy  +  nfactory  * 

((doubia) (gcurva.midtima  -  i))  /  gcurva.midtima ; 

> 

aiaa  { 

nrangax  =  minnaighx ; 
nrangay  =  minnaighy  ; 

> 

neighfO]  =  nrangax ; 
neighjlj  =  nrangax  ; 
weightem  (map) ; 

> 

save  net  0  ; 

prmtf  (“NnNet  file:  %a  saved!\n ',  nat  file)  ; 

> 

/* 

•MMMiutwimiMnmMMMU  nweight44.c  ••••«»»••*•*••»•*•*•••••*• 

These  routines  support  TWOBAS4.C/EXE  in  training  a  second 
Kohonen  neural  net.  Inputs  are  stored  in  a  Vdat  file. 

Inputs  are  100  x-y  pair  trajectories  filled  with  trailing  -1's. 


G  BARMORE25  AUG  88 
V 

#  include  math 

#  include  stdio 

#  include  stat 


twobasA 


double 

innputl100][100][2]  J*  input  vectors  */ 

extern  double 

input[100](2]  i  /*  input  nodes  */ 

extern  double 

gain ; 

extern  int 

closest[2]  ;  1*  closest  node  V 

extern  int 

neigh(2]  ;  /•  neighbor  •/ 

extern  int 

xsize,  ysize  ;  /•  Size  of  array  */ 

extern  int 

number  Jnputs  ; 

extern  int 

train_discrete  ; 

extern  char 

training_file(30] ; 
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extern  char 

int 

int 

int 

char 

read  tm  file  0 

{ 

FILE 

int 


firet_net_file[30] ; 

number_diecretee ; 
word_counter ; 
num_worde  ; 
word_number[100][15] ; 


*tf,  *1net ; 

j,  i,  r,  c,  x,  y  ; 


fnet  =  toper  (trainingjile,  “r”) ; 
fscanf  (fnet,  "%d",  &num_words) ; 
for  (i  =  0  ;  i  <  num_worda  ;  i+  +)  { 

for  (j  =  0  ,  j  <  number  inputs  ;/++){ 

fscanf  (fnet,  "%d  %d",  &x,  &y) ; 
innput[i][j][0]  =  x ; 
innput[i](j][lj  =  y ; 

} 

> 

fcloee  (fnet)  ; 
word  counter  =  -1  ; 

} 


getin  0 

{ 

int  j ; 


I 


> 


word_counter+  +  ; 
if  (word_counter  =  =  num_worde) 
word_counter  =  0 ; 


get  md  in  0 

{ 

int  i,  j ; 

double  max_rand  =  pow  (2.0,  31.0)  ■  10  ; 

int  pointer ; 

pointer  =  floor  ((randO  *  (num  words  -  0001)  /  max  rand))  ; 

> 


weightem  (map) 

float  map(20]  (20]  ( 1 00]  [2]  ; 

{ 

int  nright,  nleft,  nup,  ndown,  r ,  c.  i ; 

if  (neigh[0]  >  0  &&  neighfl]  >  0)  { 

nright  =  closest  [0]  +  neigh[0]  - 1  ; 
if  (nright  >  =  xsize) 

nright  =  xsize  •  1  ; 
nleft  =  closest[0]  -  neigh(0]  +  1  ; 
if  (nleft  <  0) 

nleft  =  0; 

nup  =  close8t[1]  •  neigh]  1]  +  1  ; 
if  (nup  <  0) 

nup  =  0  ; 

ndown  =  closest!  1]  +  neigh[l]  •  1  ; 
if  (ndown  >  =  ysize) 
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ndown  =  ysize  - 1  ; 

> 

eiae  { 

n right  =  cloee*t[0]  ; 
nleft  =  clo*eet{0] ; 
nup  =  clo*e*t[1] ; 
ndown  =  ctose*t[1] ; 

> 

for  (r  =  nup;  r  <  =  ndown  ;  r+  +)  { 

for  (c  =  nleft ;  c  <  =  nright ;  c+  +)  { 

for  (i  =  0  ;  i  <  number Jnputa  ;  i++)  { 
map[r][c](i][d]  +=  gain* 

(innput[word_count*r][i][01  -  map[r]  [c]  [i]  [0])  ; 
map[r)(c](ll[1]  +  =  gain  * 

{innput[word  counter][i][1J  -  map[r][c][i][1]) ; 

> 

> 
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$  link  twomask5,  options  file/opt 

/* 

.................................  ........................ 

Routine  to  create  *.msk  file  from  ‘.net  file  where  *.mak  file 
is  array  of  integers  mask [20] (20]  corresponding  to  nodes  of  ‘.net 
file. 


Each  integer  is  the  number  of  weights  which  are  not  -1 . 
Trajectories  (node  weights)  are  100  x-y  pairs  filled  with 
trailing  -Ts. 


*/ 

#  include  math 

#  include  stdio 

int 
float 
double 

int 
int 

char 
char 

non_zero  (map) 
float 

{ 

int 

for  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  xaize  ;  c+  +)  { 

number  =  number Jnputs-H  , 
y  =  (x  =  -1)  ; 

while  ((y  =  =  -1)  44  (x  =  =  -1)  44  (number  >  1)){ 
number-  ; 

x  =  map[r][c]  [number- 1][0J ; 
y  =  map[r](cj[numb*r-1][1]  ; 
printf  ("*id  %2d  ",  x,  y)  ; 

} 

printf  (‘Vi****  %d  *“*\n",  number)  ; 
mask[r][c]  =  number  ; 


main  0 

{ 

printf  (‘VtTWOMASM  (Creates  net  mask  for  2-D  trajectories\n\n)  ...  ")  ; 
find  mask  0  ; 

} 

find  mask  0 

{ 

int  r,  c,  i,  x,  y  ; 

FILE  *fnet ; 

printf  (“Enter  name  of  output  Koh  net_file  [less  net];  ") ; 
scant  ("%s",  temp_file)  ; 


mask  [20]  [20]  ; 

map [20]  [20]  [100] [2]  ;  /*  output  nodes  */ 
node  dist ; 

xsize,  ysize  ;  /*  Size  of  array  */ 
number  Jnputs ; 

training_file[30],  temp  file[30],  first  net  file[30]  ; 
net_file[30] ; 


map[20]  [20]  [  1 00]  [2]  ; 
r,  c.  i,  number,  x,  y  ; 
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sprintf  (netjilc.  “%*.net",  temp_file)  ; 
sprint!  (trainingjile,  "%a.mak".  tempjile)  ; 

fnet  =  (open  (net_file,  “r")  ; 

(scan!  (fnet,"%d  %d  %d”,  &ysizs,  ixsize,  &numberjnputs) ; 
for  (f  =  0  ;  r  <  ysize  ;  r+  +)  { 

for  (c  =  0 ;  c  <  xsize  ;  c+ +)  { 

for  (i  =  0 ;  i  <  numberjnputs  ;•++){ 
fscanf  (fnet,"  %d  %d",  &x.  &y) ; 
map[r][c][i][0]  =  x , 
m«p[r][c][i][1]  =  y  ; 

> 

> 

> 

(close  (fnet)  ; 
non_zero  (map)  ; 
save  mask  0  ; 

} 

savemask  0 

{ 

FILE  ‘(mask ; 

irrt  r,  c  ; 

fmask  =  (open  (training_file,  "w”)  ; 
for  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  xsize  ;  e+  +)  { 

fprintf  (fmask,  “%d  ",  mask[r][c])  ; 

} 

} 

f close  ((mask)  , 

> 
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$  Hr*  twopic4c,nplot,nprirTt*r,mat3,nwt4, option*  tile/opt 

r 

MnntHMtMntMMiMWHtHM  tWOpic4c.C  ************************' 
This  routine  is  used  to  show  graphically  those  nodes  which  'light 
up'  using  Euclidean  distance  when  the  training  set  of  inputs  is 
applied  to  a  second  Kohonen  net. 

Inputs  are  100  x-y  pair  trajectories  filled  with  trailing  -1's. 


*/ 


#  include  math 

#  include  stdio 

#  include  time 

float 

map[20]  [20]  [  1 00]  [2]  ;  /*  output  nodes  */ 

double 

input[l00](2] ;  /*  input  node*  */ 

double 

gain,  noise ; 

double 

mcount ; 

double 

percent ; 

double 

xoff  =  0.0  ; 

double 

yoff  =  0.0 ; 

double 

nod*_dist , 

int 

closest[2)  ;  /*  closest  node  */ 

int 

neigh[2] :  1*  neighbor  */ 

int 

nrangex,  nrangey  ;  /*  neighbor  range  */ 

int 

rrfactorx,  nfactory  ;  /*  neighbor  factor  */ 

long 

count ;  /*  #  of  iterations  V 

int 

graph  ;  /•  #  between  plots  V 

int 

seed ; 

int 

maxneighx,  maxneighy  ;  /*  Starting  area  */ 

int 

minneighx,  minneighy  ;  /*  Final  area  */ 

int 

xsize,  ysize  ;  J*  Size  of  array  V 

int 

number Jnputs  , 

int 

wrap_flag  =  0  ; 

int 

tram  fiag,  train_discrete  ; 

char 

training_file[30],  temp_file(30),  first_net_file[30] 

char 

net_file[30] ; 

struct  curve  { 

int 

type ; 

double 

maxgain  ; 

double 

mingain  ; 

double 

midgain  ; 

int 

midtime  ; 

}  gcurve 

■' 

extern  int 

xyQ  ;  /*  array  holding  x.y  */ 

extern  double 

xdef,  ydel ; 

extern  double 

xlow,  xup,  yiow,  yup  ; 

extern  int 

num_words ; 

extern  char 

word_numb*r[100][15]  ; 

mindist  (map.  inp,  close) 

double 

inp[100][2]  ; 

int 

close[2]  ; 

float 

int 

map[20]  [20]  [  1 00J  [2]  ; 

r,  c,  i ; 
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double  diet ; 

double  minimum  -  9.96*31 ; 


} 


for  (r  =  0  ;  r  <  yeize ;  r+  +)  { 

for  (c  =  0  ;  c  <  xsize  ;  c+  +)  { 
diet  =  0.0 ; 

for  (i  =  0  ;  i  <  number Jnpute  ;  i+  +) 

diet  +  =  f*b#7inp{i](0]  -  mep[r]{c](i][0J)  + 
faba(inp[i][1]  -  map[r][c][i][1])  ; 
if  (diet  <  minimum)  { 

minimum  =  diet ; 
cio*e[0]  -  c ; 
cloeejl]  =  r ; 

> 

> 

> 

node_dist  =  minimum ; 


main  0 

{ 

int  c ; 


printf  ("\nTWOPIC4c  (Plot  Words  for  2-0  Reduced  Queued  Traj)...\n ") ; 
mapspeech  0  ; 


map_ speech  0 
{ 


int  r,  c,  i,  j,  k.  x,  y  ; 
char  sub_title[60],  temp(30]  ; 
char  name  trj[20] ; 

int  loc[125][2] ; 

FILE  *fnet.  *flog  ; 

int  sound ; 

short  length ; 


printf  ("VnErrter  name  of  pre-processor  Koh  net-file  [lose  net]:  ") ; 
scant  (“%a"t  temp)  ; 
s printf  (first_net_file,  "%a.net",  temp) ; 

printf  ("Enter  name  of  header  file  containing  words  (less  .hdr):  ")  ; 

scarrf  ("%s",  temp_file)  ; 

sprintf  (trainingjile,  “%a.hdr",  tempjile)  ; 

printf  ("Enter  name  of  output  Koh  net_file  [less  net]:  ") ; 

scant  (“%a",  temp_file) ; 

sprintf  (netjile,  “%s.net",  temp_file)  ; 

readjmjile  0  ; 

fnet  =  fopen  (net_file,  “r")  ; 

fscanf  (fnet,"%d  %d  %d",  &ysize,  Axsize,  &numb*r_inputs) , 
for  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  xsize  ;  c+  +)  { 

for  (i  =  0  ;  i  <  numberjnputs  :  i++)  { 

fscanf  (fnet,"  %d  %d",  &x,  &y)  ; 
map[r][c][i][0]  =  x ; 
m«p[r][c][i][l]  =  y ; 

> 
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> 

tcloee  (fnat) ; 

sprint*  (subjitle,  "%e  ->  %a  first_nat_fil«,  netjile) ; 
sprint*  (nametrj,  “%e.trj"\  tamp) ; 


flog  =  fopan  ("1emp.log", “w”) ; 

(print*  (flog.  “TWOPKXc:  %a",  nam.tq) ; 

graphtest  (trainingjile)  ; 
length  =  (short)  strien  (subjitle) ; 
drawgrkfi  (ysize,  xsize,  sub_titie,  length) ; 

print*  ("VtExpect  %d  calculations. \n”,  num_words) ; 

(or  (sound  =  0  ;  sound  <  num_words  ;  sound  -*-+){ 
getin  0  I 

mindist  (map,  input,  &loc(sound](0])  ; 
print*  (“%d  :  (%d,%d)  diet  =  %le\n  \ 

sound,  loc(sound][0],  loc[sound](1],  node_dist)  ; 
tprintt  (flog,  "%d  :  [%d,%d]  diet  =  %le\ri", 

sound,  loc[aound}(0],  loc[sound][1],  node  diet)  ; 

> 

print*  OnCalculations  finishedAn  ”) ; 

(close  (flog)  ; 

drawspeechmap  (sound,  loc)  ; 
scan*  (“%e '.temp) ; 
clipoff  0  ; 
graphoff  0  ; 


graphteat  (name) 

char  name(30]  , 

{ 

char  title[79],  labetx[79) ; 

float  xloc(5]  =  {0,  639  0,  639  0,  0  0,  0.0}  ; 

float  yloc[5]  =  (349  0,  349.0,  0.0,  0.0,  349  0}  ; 

int  points  =  5  ; 

in*  wsjd  =  1  ; 

int  clear_flag  =  1  ; 

short  length ; 


sprintf(title,’TWOPlC4c:  Kohonen  TWO  NETS  -  %s ",  name)  : 
sprintf(labeb(,"  ")  ; 
graphon  0  ; 

gks$clear_ws  (&wsjd.  &clear_flag)  ; 
gks$polyline  (&points,  xloc,  yloc)  ; 
prepcolmat  (ysize,  xsize) ; 
length  =  (short)  strien  (title) ; 
outtitle  (title,  length) ; 
length  =  (short)  strien  (labeix) ; 
outlabetx  (labeix,  length)  ; 
clipon  0  I 


These  routines  support  TWOPIC4C.C/EXE  in  finding  which  node  lights 
up  in  a  second  t.ohonen  net  when  a  training  digit  is  applied. 


B- 141 


Append*  0:  Computer  Program* 


Input*  ar*  100  x-y  pair  trajectories  filled  with  trailing  -V*. 
Eudktean  dwtenc*  is  uaad  in  finding  which  nod*  light*  up. 


#  includ*  math 

#  Includ*  «tdio 

#  includ*  atet 


ext  am  doubt* 

inputI100][2j ;  r  input  node*  */ 

extern  doubt* 

gain ; 

extern  int 

clo*e*t(2] ;  /*  closest  nod*  V 

extern  int 

n*ight2) ;  /*  neighbor  */ 

extern  int 

xsize,  yaiz* ;  /*  Size  of  array  V 

extern  int 

number  Jnputs ; 

axiom  int 

train_di*cr*t* . 

extern  char 

training_file[30) ; 

extern  char 

first_nat_file{30] ; 

int 

numberdiscrete* ; 

int 

word_counter ; 

int 

num_word* ; 

char 

word  jiumb*r[1 00]  (1 5]  ; 

int 

f_ysize,  f  xsiza,  f  number  input* 

float 

f_map[20]  (20)  [  1 6]  ; 

read  tm  fila  0 

( 

FILE  *tf.  *fn*t ; 

int  i,  r,  c  ; 

tf  =  fopan  (trainingfile,  "r")  ; 

♦scan f  (If,  "%d”,  &num_words)  ; 
for  (i  =  0  ;  i  <  num_worda  ;  i+ +) 

fscanf  (tf,  "%a",  word_numbar[i))  ; 
fclosa  (tf) ; 
word_counter  =  0 ; 

fnat  =  fopan  (first  natjila,  “r") ; 

fscanf  (fnet,”%d  %d  %d".  &f_ysize,  &f_xsi2*,  &f_numb*r_inputs)  ; 
for  (r  =  0  ;  r  <  f_ysiza  ;  r+  +)  { 

for  (c  =  0  ;  c  <  f_xsize  ;  c+  +)  { 

for  (I  =  0  ;  i  <  f_numb*rjnput*  ;  i+  +)  { 

fscanf  (fnat,"  %if",  &f  map[r][c][ij) ; 

> 

} 

fclosa  (fnat) ; 

} 

getin  0 

{ 

if  (word_counter  =  =  num_word*) 
word_countar  =  0 ; 
rsad_word  (word_countar)  ; 
word_counter+ +  ; 
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gat  md  in  0 
{  ' 

int  I ; 

doubt*  max  jand  =  pow  (2.0, 31.0)  - 1.0 ; 

int  pointer ; 

pointer  =  floor  {(randO  *  (num_worda  •  .0001)  /  max_rand)) ; 
reed  word  (pointer) ; 

> 


reedjeord  (pointer) 
int 

{ 

int 

double 

flo* 


pointer ; 

flag,  r,  c.  i,  j.  k  ; 

inf  16),  dl,  d2,  d3,  d4,  dS  ; 

element ; 


int  Ioc2[2000)[2).  Ioc3[2000][2]  ; 

FILE  *fend ; 

int  sound,  point,  xfS],  y[5]  ; 

int  max_pt* ; 

double  max ; 

tend  =  (open  (word_number[pointer],  “r")  ; 

sound  =  0 ; 

i  =  0; 

flag  =  0 ; 

while  (flag  1=  1)  { 

fecanf  (fsnd,  "%f’,  Aeiement)  ; 
if  (feof(fend)  I  =0) 
flag  s  1  ; 
else  if  (i  >  99) 

flag  =  1 ; 


infij  =  (double)  element ; 

I+  +  ; 

I  > 

if  ((i  =  =  15)  &&  (flag  ==  0))  { 

f  mindist  (f  map,  in,  &loc2[sound)[0}) ; 

f-o; 

80und++  ; 

} 

> 

I  fclose  (fsnd)  ; 

for  (i  =  0  ;  i  <  sound  ;  i+  +)  { 

Ioc3(i](0]  =  Ioc2(i](0]  ; 
loc3(i](1]  =  loc2[i](1) ; 

} 

max_pts  =  sound ; 

(  ...  Trajectory  Reduction  ... 

if  (j  >  =  number_inputs) 

j  =  numberjnputs  ; 
for  (i  =  0  ;  i  <  j ;  i++)  { 

input[i][0]  =  Ioc2[i][0] ; 
input(i]llj  =  loc2(ij(lj  ; 

I  for  (i  =  j ;  i  <  number Jnputs  ;  i  +  +)  { 
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1 


inputtiHO]  =  (input[i][1]  -  -1.0) ; 

> 


»_mindiat  (f_map,  mp,  do**) 


double 

inp(16] ; 

int 

clo*e[2] ; 

float 

f_map[20][20][16) ; 

int 

r,  c,  i ; 

doublo 

dial ; 

doubia 

minimum  =  9.9*31 

for  (r  =  0 ; 

r  <  f_y*ize ,  r+-r)  { 

for  (c  =  0 ;  c  <  fjcaiza ;  c+  +)  { 
diet  =  5.0 ; 

for  (i  =  0  ;  I  <  f_numb*rjnput»  ;  i  +  +) 

dial  +  =  pow  (inp[i]  -  ♦_maplr)[c)(i],  2.0) ; 
if  (dist  <  minimum)  { 

minimum  =  diet  ; 
c)om{0]  =  c ; 
clo**{lj  =  r ; 

} 
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$  link  twopic8b,nwin6b,options  fite/opt 

r 

A********************************  twopteSb  c 


This  routine  find*  the  closest  digit  (from  a  group  at  digits)  to 
each  node  in  a  second  Kohonen  net.  In  particular,  this  routin* 
usee  100  x-y  pair  trajectoriea  filled  with  trailing  -1‘a. 


For  each  node,  the  routine  searchee  through  the  whole  list  for  the 
digit  ‘closest’  to  that  node’s  weight.  'Closest'  in  this  css* 
is  found  through  a  mini-DTW  that  uses  both  the  node's  masked 
length  (without  trailing  -I  s)  and  the  length  of  the  trajectory 
(also  without  *1‘s). 

Oats  output  includes  the  node  number,  distance  to  the  digit 
found  cloeeet.  and  the  name  of  the  *.tm  file  of  the  digit. 

V 

#  include  math 

#  include  stdio 

#  include  time 

float 

map[20]  [20]  [1 00]  [2]  .  /*  output  nodee  */ 

double 

input[l00][2] ,  /*  input  nodea  */ 

double 

nodediet ; 

int 

do8*et[2]  ,  /*  closest  nod*  •/ 

int 

xsize,  ysize  ;  /*  Size  of  array  •/ 

int 

number  Jnputs  ; 

char 

training  file[30],  temp  file[30],  first_net_file[30] 

char 

net_file[30] ; 

extern  int 

num  words  ; 

int 

mask  [20]  [20] ; 

int 

map2[20][20][100][2]  , 

float 

aa  =  0.75 ; 

float 

bb  =  0.75 ; 

extern  int 

f_x8ize,  f_ys«e ; 

extern  int 

location  [200C]  [2] ; 

int 

innput[200][t00][2]  ; 

extern  int 

length[200] ; 

extern  char 

word_number[200][15] ; 

mindist  (r,  c,  close) 

int 

r.  c  ; 

int 

•close  , 

\ 

int 

sound  ; 

double 

dist ; 

double 

minimum  =  9.99e31  ; 

for  (sound  =  0  ;  sound  <  num_words  ;  sound  +  +)  { 

dtw  (&map2[r][c][0][0],  &innput[sound][0][0],  mask[r][c), 
length  [sound],  &dist)  ; 
if  (dist  <  minimum)  { 

minimum  =  dist  ; 

•close  =  sound  ; 

> 
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} 

node  diet  =  minimum  ; 

} 

mein  0 

{ 

mt  c ; 

printf  ("VnTWOPtCSb  (Cloeeet  word  for  each  node:  100  wta/2-0  ).  .\n") ; 
map  speech  0 ; 

> 


map  speech  0 

{ 

int 

r,  c.  i,  j,  k,  x.  y  ; 

char 

name_trj[30],  temp[30] 

int 

loc ; 

FILE 

•fnet,  *f)og,  *fmask  ; 

printf  ("\nEnter  name  of  pre-processor  Koh  net -file  [less  .net]:  ")  ; 

scant  ("%s",  temp) ; 

sprintf  (first_net_file,  "%s.net",  temp)  ; 

printf  ("Enter  name  of  header  file  containing  words  (less  hdr)  .  ")  ; 

scant  ("%s",  tempfile) ; 

sprintf  (trainingjile,  "%e.hdr",  temp_file) : 

printf  ("Enter  name  of  output  Koh  net_fiie  (less  net]:  ") ; 

scant  ("%s",  temp_file) ; 

sprintf  (net_file,  "%s.net",  tempjile) ; 

sprintf  (temp,  “%s.msk",  temp_file)  ; 

fnet  =  fop en  (net_file,  “r")  ; 

fscanf  (fnet,"%d  %d  %d",  &ysize,  &xsize,  &number_inputs) ; 
for  (r  =  0  :  r  <  ysize  ;  r+  +)  ( 

for  (c  =  0  :  c  <  xsize  :  c+  +)  { 

for  (i  =  0 ;  i  <  number Jnpute  ;  i+  +)  { 
fscanf  (fnet,"  %d  %d",  4x,  &y) ; 
map2[r][c][i][0]  =  x ; 
m*p2M(c](i](l]  =  y ; 

> 

} 

} 

fclose  (fnet) ; 

read_trn_file  0 

fmask  =  fopen  (temp,  “r")  ; 
for  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

for  (c  =  0 ;  c  <  xsize :  c+  +)  ( 

fscanf  (fmask, "%d",  &mask[r][cj) ; 

> 

> 

f close  (fmask) ; 


flog  =  fopen  ("temp.log'V’w") : 

fprintf  (flog,  "TWOPIC8b:\n")  ; 

fprintf  (flog,  %s  ->  %s  ->\n",  first_net_file,  netjils) ; 

fprintf  (flog,  "Size  is  %d  by  %d  nodes\n",  xsize.  ysize) ; 
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printf  ('Vi Expect  %d  calculations.^",  num_worda) ; 
fprintf  (flog,  “Expect  %d  calculations.^",  num_worda)  ; 
printf  (Anfleading  word:  ") ; 
for  (r  =  0 ;  r  <  num_worda  ;  r+  +)  { 
printf  (“%d  ”,  r)  ; 
getin  0 ; 

for  (c  =  0 ;  c  <  number Jnputs ;  c+  +)  { 
innput[r][c](0]  =  location[c][0] ; 
innpotjrjic][lj  =  location[cj[1] ; 

> 

> 

printf  (An”) ; 

for  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

for  (c  =  0 ;  c  <  xsize  ;  c+  +)  { 
mindist  (r,  c,  &loc) ; 
k  =  c  +  r  *  xsize ; 

printf  (AnNode  %3d  :  word  #  %3d,  diet  =  %le  ", 
k,  (oc,  node_dist) ; 
printf  (“(%«)",  word_number(loc]) ; 
fprintf  (flog,  AnNode  %3d  :  word  #  %3d,  dist  =  %le  ", 
k,  loc,  node_dist) ; 

fprintf  (flog,  “(%s)".  word  number[loc]) : 

} 

} 

printf  (AnCaiculations  finishedAn")  ; 
fcloee  (flog)  ; 

> 

dtw  (templets,  utterance,  tjength,  ujength,  ave_dist) 
int  template[200] [2] ,  utterance[200)[2]  ; 

int  t_length,  ujength  ; 

double  *«ve_diat ; 

{ 

float  back_path[2][200]  ; 

int  b_p[2]  [200]  ; 

int  r,  c ; 

int  ptr,  b  ptr ; 

float  d1,d2,  d3,  diet; 

dist  =  0.0  ; 
b_ptr  =  1  ; 
b_p[0][0J  =  1  : 

for  (r  =  t  ;  r  <  t  length  ;  r+  +) 

b_p[0f{r]  =  b_p(0)(r-1]  +  1  ; 
for  (r  =  0  ;  r  <  t  length  ;  r+  +)  { 

back_path[0][r]  =  (dist  +=  bb  *  ( 

abs(utterance[0][0]  •  template[r}(0})  + 
abs(utterance[0][1)  -  template[r][1])))  ; 

> 

for  (c  =  1  ;  c  <  ujength  ;  c+  +)  { 
if  (b_ptr  =  =0)  { 

b_ptr  =  1  ; 
ptr  =  0 ; 

} 

else  { 

botr  =  0 ; 
ptr  =  1  ; 

} 

for  (r  =  0  ;  r  <  tjength  ;  r+  +)  { 

dist  =  abe(utterance[c][0]  -  template(rj[0])  + 
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abe(utterance[c][1)  -  t*mplate[r][1})  ; 
«(r==0){ 

back_path[ptr][r]  =  back_path[b_ptr][r]  + 
(aa  *  diet) ; 

b_Plptr]]r]  =  b_p]b_ptr][r]  +  1  ; 

} 


{ 


dl  =  back_path]b_ptr][r-1]  +  diet ; 
d2  =  back_path{ptr][r-1]  +  (bb  *  diet) ; 
d3  =  back _path(b_ptr](r]  +  (aa  *  diet) ; 
if  (d2  <  =  d3  &&  d2  <  d1){ 

back_path[ptr](r]  =  d2 ; 
b_p{ptr]]r]  =  b_p[ptr][r-1]  +  1 ; 
> 

eiee  if  (d3  <  =  d2  44  d3  <  dl)  { 
baek_path(ptr](r]  =  d3  ; 
b_p(ptr][r)  =  b_p[b_ptr][r]  +  1  ; 
> 


else  { 


back_path[ptr][r]  =  dl  ; 
b_p[ptr)M  =  b_p[b_ptr][M)  +  1 
> 


> 


> 


if  (b _p[ptr J  [t_l#ngth- 1  ]  !=  0) 

*ave_dist  =  back_p*th[ptr]]t_l*ngth-1]  /  b_p[ptr)lt_ length-1]  ; 

else 

•eve  diet  =  9.9*31  ; 


•ntMttiMtnniMntn*  nwin6b.c  ••••••••••*•••••••••••«•**••< 

These  routines  support  TWOPIC88.C/EXE  in  finding  •  digit  from  a 
specified  set  that  is  closest  to  each  node  in  a  second  Kohonen  net. 


Inputs  are  100  x-y  pair  trajectories  filled  with  trailing  -I  s. 

Q.  BarmoraZS  Aug  88 


#  include  math 

#  include  stdio 

#  include  stat 

extern  double 

input]  100]  [2]  ;  /*  input  nodes  */ 

extern  double 

gain  ; 

extern  int 

clos*st[2]  ;  /*  closest  node  */ 

extern  int 

neigh{2) ;  /*  neighbor  */ 

extern  int 

xsize,  ysize  ;  /*  Size  of  array  */ 

extern  int 

numberjnputs  ; 

extern  int 

train_discrat*  ; 

extern  char 

training_file[30]  ; 

extern  char 

fir*t_n*t_file{30]  ; 

int 

number_discretes  ; 

int 

word_counter ; 

int 

num  words ; 
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Cher  word  number[200][15] ; 

int  length  [200]  ; 


int  f_ysize,  f  xstze,  f  number  inputs  ; 

float  f_map[20]  [20]  ( 1 6] ; 

int  location  [2000]  [2] ; 

extern  int  m«p2[20][20][100}[2] ; 

extern  float  m»p[20][20][100][2] ; 

read  tm  file  0 

{ 

FILE  *tf,  *<net ; 

int  i,  r,  c,  k,  temp  ; 

tf  *  fopen  (trainingjile,  V) ; 
tscanf  (tf,  "%d",  &num_words) ; 
for  Q  =  0  ;  i  <  num_worde  ;  i+  +) 

fscenf  (tf.  '■%#",  word_number[i])  ; 
fefoee  (tf) ; 
word  counter  -  0  ; 


fnet  =  fopen  (first_net_file,  "r")  ; 

fscenf  (fnet,"%d  %d  %d",  Af_yeue,  Sf  xsize,  Af_number_input») ; 
for  (r  =  0 ;  r  <  f_ysize ;  r+  +)  { 

for  (c  =  0  ,  c  <  f_xsize  ,  c+  +)  { 

for  (i  =  0  ;  i  <  f_number_inputs  ;  i++)  { 

fscenf  (fnet,"  %f",  &f  mep[r][c][i])  , 

} 

> 

> 

fdose  (fnet) ; 

> 

getin  0 

{ 

if  (word_counter  =  =  num_words) 
word_counter  =  0  ; 
read_word  (word_counter)  ; 
word_counter+ +  ; 


get  rnd  in  0 

{ 

int  i ; 

double  maxjand  =  pow  (2.0,  31  0)  - 1.0  ; 

int  pointer ; 


pointer  =  floor  ((randO  *  (num_words  •  .0001)  /  max_rand))  ; 
readword  (pointer)  ; 


readword  (pointer) 


int 

pointer ; 

int 

flag,  r,  c,  i,  j,  K  ; 

doubt* 

in]  16),  dl,  d2,  d3,  d4,  d5  ; 

float 

element ; 

int 

Ioc2[2000][2],  Ioc3[2000][2] 

FILE 

•fsnd  ; 
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int  sound,  point,  x[5],  y[5]  ; 

int  max_pta ; 

double  max ; 

tend  =  topen  (word_number  [pointer] ,  “r") ; 

sound  =  0 ; 

i  =  0 ; 

flag  =  0 ; 

while  (flag  !  -  1)  { 

fscenf  (tsnd,  “%T,  Aeiement) ; 

»(fecf(fs nd)  !=0) 
flog  =  1 ; 
else  if  (i  >  99) 

flag  =  1 ; 

•tea  { 

in[i]  =  (double)  element ; 
i++  ; 

> 

if  ((i  ==  15)  44  (flag  =  =0))  { 

f  mindist  (f  map,  in,  &loc2[sound][0]) ; 
i  =0; 
sound +  +  ; 

> 

} 

fclose  (fsnd)  ; 

for  (i  =  0  ;  i  <  sound  ;  i  +  +)  { 

Ioc3[i][0]  =  Ioc2[i][0]  ; 
loc3[i][l]  =  loc2[i][1]  . 

> 

max_pts  =  sound ; 

...  Trajectory  Reduction ... 

for  (i  =  0  ,  i  <:  j ;  i++)  { 

location[i][0]  =  Ioc2[i][0] ; 
locationjijjlj  =  loc2[i][lj  ; 

} 

length[pointer]  =  j ; 
for  (i  =  j ;  i  <  2000  ;  i  +  +) 

location [i][1  ]  =  (location(i][0]  =  -1)  ; 


f_mindist  (f_map,  inp,  close) 

double  inp[16]  ; 

int  close(2]  , 

float  f  mapl20][20][16]  ; 

{ 

int  r,  c,  i ; 

double  dist ; 

double  minimum  =  99999.9  ; 

for  (r  =  0  ;  r  <  <_ysize  ;  r+  +)  { 

for  (c  =  0  ,  c  <  f_xsize  ;  c+  +)  { 

dist  =  5.0 ; 

for  (i  =  0  ;  i  <  fjiumberjnputs  ;  i+  +) 

diet  +=  pow  (inp[i]  -1_map[r][c][i],  2.0)  ; 

if  (dist  <  minimum)  { 

minimum  =  dist ; 
close[0]  =  c  ; 
closejl]  =  r ; 
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$  link  twopic6b,nwin5b,k>okup6, options  file/opt 

r 

•MMmmMHtlHMMMMMMtt  tWOpitS.C  ****•*****••*««**•••«*•»**•**« 

This  routine  finds  the  closest  node  in  e  second  Kohonen  net  (and 
the  digit  assigned  to  it  from  twopicSb.c)  to  each  digit  in  a  set 
of  teat  digits. digits).  In  particular,  this  routine 
usee  100  x-y  pair  trajectories  filled  with  trailing  -1‘s. 

For  each  test  digit,  the  routine  searches  through  every  node  in  the 
Kohonen  net  for  the  node  'closest'  to  that  digit.  'Closest'  in  this 
case  is  found  through  a  mini-DTW  that  uses  both  the  node's  masked 
length  (without  trailing  -1's)  and  the  length  of  the  trajectory 
(also  without  -1's). 

Once  the  closest  node  is  identified,  the  digit  assigned  to  it 
from  twopicSb  is  found  by  a  look-up  table  (Iookup6.c). 

Data  output  includes  the  digit  number  (actually  the  place  in  the 
test  set  that  the  digit  resides  at),  distance  to  the  node 
found  closest,  and  the  name  of  the  *.trn  file  of  the  digit,  and 
the  digit  assigned  to  the  closest  node. 

Thus,  this  is  the  end  test  of  the  second  Kohonen  net.  Will 
test  digits  light  up  a  node  assigned  to  the  same  class  of  digit? 


•/ 

#  include  math 

#  include  stdio 

#  include  time 


float  map[20][20](100][2] ;  /*  output  nodes  */ 

double  input[100][2] ;  /*  input  nodes  */ 

double  node_dist ; 

irrt  xsize,  ysize  ,  /*  Size  of  array  */ 

int  number_inputa ; 


char  training_file[30),  temp_fils(30J,  flrst_net_file[30J ; 

char  net_file[30J ; 

extern  irrt  num_words  ; 

int  mask[20][20]  ; 

int  map2[20](20][l00][2] ; 

float  aa  =  0.75  ; 

float  bb  =  0.75  ; 

extern  int  f  xsize,  f_ysize  ; 

extern  int  length[200]  ; 

extern  int  location  [2000]  [2]  ; 

mindist  (close) 

irrt  close{2]  ; 

{ 

irrt  r,  c,  i  ; 

double  dist ; 

double  distance ; 

double  minimum  =  9.99e31  ; 

double  pi ,  p2  ; 


for  (r  =  0  ;  r  <  ysize  ;  r++)  { 
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> 


for  (c  =  0  ;  c  <  xsize  ;  c+  +)  { 

dtw  (&map2[r][c][0][0),  location,  mask[r][c], 
length[0],  &dist)  ; 
if  (dial  <  minimum)  { 

minimum  =  diet ; 
cloaelO)  =  c  ; 
cloaajlj  =  r , 

> 

> 

> 

node_dist  =  minimum ; 


main  0 

{ 

int  c ; 


printf  (“\nTWOPIC6b  (DTW  Words  for  2-D  Reduced  Queued  Traj)...\n”)  ; 
mapspeech  0  . 


mapspeech  0 
{ 


int  r,  c,  i,  j,  k,  x,  y  ; 

char  subjitle[60],  temp[30)  ; 
char  namejrj[20] ; 

int  loc[2]  ; 

FILE  *tnet,  ‘flog,  *fmask  ; 

int  sound  ; 

short  length ; 


printf  (“\nEnter  name  of  pre-processor  Koh  net-file  (less  net]:  ") ; 

scant  (“%8 ",  temp)  ; 

sprintf  (first_netjile,  "%s.net",  temp)  ; 

printf  (“Enter  name  of  header  file  containing  words  (less  .hdr):  ")  ; 

scant  (“%8",  tempjile)  ; 

sprintf  (trainingjile,  “%s.hdr“,  tempjile)  ; 

printf  (“Enter  name  of  output  Koh  netjile  [less  net],  ") ; 

scanf  (“%8",  temp_file)  ; 

sprintf  (netjile,  “%s.net",  tempjile) ; 

sprintf  (temp,  “%8.msk",  temp_file)  ; 

fnet  =  fop en  (netjile,  "r")  ; 

fscanf  (fnet,"%d  %d  %d",  &ys«e,  &xsiza,  &numberjnputs)  , 
for  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  xsize  ;  c+  +)  { 

for  (i  =  0  ;  i  <  number_inputs  ;  i  +  +)  { 
fscanf  (fnet,“  %d  %d”,  &x,  &y)  ; 
map2(r][c](i][0]  =  x ; 
map2[rUcUi][11  =  y  ; 

> 

> 

> 

fclose  (fnet)  , 

readjrnjile  Q  ; 

fmaak  =  fopen  (temp,  "r") ; 
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tor  (r  =  0 ;  r  <  ysize ;  r+  +)  { 

for  (c  =  0 ;  c  <  xsize ;  c+ +)  { 

fscanf  (fmeak.’Sd",  &mask[r][c]) ; 

> 

} 

fcioM  (fmask) ; 

flog  =  topen  (“temp.tog”,'V) ; 

fprintf  (flog,  •TWOPICeb:^") ; 

fprintf  (flog,  "->  %*->%*  ->\n",  first  jtetjile,  netjil*)  ; 

fprintf  (flog,  ‘Size  »  %d  by  %d  nodeeVn",  xsize,  ysize)  ; 

printf  ("\nExpect  %d  caiculetionsAn",  num_worde) ; 
fprintf  (flog,  "Expect  %d  calculetioneAn",  num_words)  ; 
for  (sound  =  0 ;  sound  <  num_words  ;  sound*  +)  { 
getin  0  ; 
mindist  (loc)  ; 

k  =  loc(0]  +  loc(1]  *  xsize  ; 
printf  ("\n%d  :  [%d,%d]  dist  =  %ie  ", 

sound,  loc[0],  loc[l],  node_dist) ; 
print_digit  (k) ; 

fprintf  (flog,  "\n%d  :  [%d,%d]  diet  =  %le  ", 
sound,  loc[0],  toc(1),  nod*_dist) ; 
fprint  digit  (k,  flog)  ; 

} 

printf  ('AnCalculations  finishedAn")  ; 
fclose  (flog)  , 


dtw  (template,  utterance,  tjength,  ujength,  avedist) 
int  template[200][2],  utterance [200] [2]  , 

int  tjength,  ujength  ; 

double  ’ave  dist ; 

{ 

float  back_path[2][200]  ; 

int  bj>[2][2001  ; 

int  r,  c ; 

int  ptr,  b_ptr , 

float  dl,  d2,  d3,  dist ; 

diet  =  0.0 ; 
b_ptr  =  1  ; 
b_P(0][0]  =  1  ; 

for  (r  =  1  ;  r  <  t  length  .  r+  +) 

b_p[0][r]  =  bj>[0][r-1]  +  1  ; 
for  (r  =  0  ;  r  <  tjength  ;  r+  +)  { 

back_path(0](r]  =  (dist  +  =  bb  *  ( 

abs(utterance[0][0]  -  template[r][OJ)  + 
abs(utterance[0]il]  -  template[rj(1]))) ; 

> 

for  (c  =  1  ;  c  <  ujength  ;  c+  +)  { 
if  (b _ptr  =  =0)  { 

b_ptr  =  1  ; 
ptr  =  0 ; 

} 

else  { 

b_ptr  =  0 ; 
ptr  =  1  ; 

> 

for  (r  =  0  ;  r  <  tjength  ,  r+  +)  { 


B-154 


Appendix  B.  Computer  Program* 


} 

r 


diet  =  ab*(utt*fance[c] [0]  -  t*mplate[r)[0])  + 
ab*(uttaranca(c](1]  -  tempiate[r][i]) , 
«(r==0){ 

back_path[ptr][r]  =  back_path[b_ptr][r]  + 
(as  *  diet)  ; 

b_Plptf](r]  =  b_p[b_ptr][r]  +  1  ; 

} 


dl  =  back_path[b_ptr]{r-1J  +  diet ; 
d2  =  back_path(ptrj[r-1]  +  (bb  *  diet) ; 
d3  =  back_path[b_ptr][r]  +  (a*  *  diet)  ; 
if  (d2  <  =  d3  &&  d2  <  d1){ 

back_path[ptr][r]  =  d2  ; 
b_p[ptr][r]  =  bj>[ptr)[r-1)  +  1  ; 

> 

eta*  if  (d3  <  =  d2  &&  d3  <  dl)  { 
back_p«th[ptr][r]  =  d3  ; 
t>_p[ptr)£r]  =  b_p[b_ptr][r)  +  1  ; 

> 

else  { 

back_path[ptr][r]  =  dl  ; 
b_p[ptr][r]  =  b_p[b_ptrj[r-1)  +  1  ; 
> 

> 

} 

> 

*ave_diet  =  back_path[ptr][t_l*ngth-1]  /  b_p[ptf][t_l*ngth-1]  ; 


nwinSb.c 


These  routines  support  TWOPIC6*  C/EXE  in  finding  the  closest  node 
to  a  given  input  digit  in  a  second  Kohonen  net. 


Trajectories  are  100  x-y  pairs  filled  with  trailing  -Vs. 


*/ 

#  include  math 

#  include  stdio 

0  include  stat 

extern  double 

input(100}(2]  ;  /*  input  nodes  */ 

extern  double 

gain , 

extern  int 

closest[2]  ;  /*  closest  node  V 

extern  int 

neigh{2)  ;  /*  neighbor  *1 

extern  int 

xsize,  ysize  ;  /*  Size  of  array  V 

extern  int 

number  Jnputs ; 

extern  int 

train  discrete  ; 

extern  char 

training_file[30]  ; 

extern  char 

first _net_file[30] ; 

int 

number  discretes ; 

int 

word_counter ; 

int 

num  words  ; 

char 

word"  number[200][15]  , 

int 

length  [200)  ; 
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int 

extern  int 
extern  float 


f_y*ize,  f  xaize,  f  number  input*  ; 
f_map[2d][20][16] ; 
location  [2000]  [2]  ; 
m*p2[20]  [20]  [  1 00]  [2] ; 
m*p[20]l2Q]t100][2] ; 


read  tm  file  0 

{ 

FILE 

int 


*tf,  *fnet ; 
i.  r,  c,  k,  temp ; 


tf  =  fopen  (training_file,  "r") ; 
fscanf  (tf,  “%d",  &num_word*) ; 
for  p  a  0  ;  I  <  num_word*  ;  i+ +) 

fscanf  (tf,  word_number[i]) ; 
fclose  (tf) ; 
word_counter  =  0 ; 

fnet  =  fopen  (firet_netjile,  “r")  ; 

fscanf  (fnet,  "%d  %d  %d",  &f_y*ize,  &f_xaize,  &f_number_input*)  ; 
for  (r  =  0 ;  r  <  f_ysiz* ;  r++){ 

for  (c  «  0 ;  c  <  f_x*iz*  ,  c+  +)  { 

for  (i  =  0  ;  i  <  f_number_input*  ;  i++)  ( 

fscanf  (fnet,"  %f",  &f  map[r][c][i]) ; 

> 

> 

> 

fclose  (fnet)  ; 


getin  0 

t 


if  (word  counter  =  =  num_word») 
word_counter  =  0 ; 
readjword  (word_courrter)  ; 
word  counter  +  +■  ; 


get  md  in  0 

{ 


int 

double 

int 


maxrand  =  pow  (2.0,  31.0)  - 1.0  ; 
pointer ; 


pointer  =  floor  ((randO  *  (num_words  -  .0001)  /  max_rancf)) ; 
read_word  (pointer) ; 


read_word  (pointer) 
int 

{ 

int 

double 

float 


pointer ; 

flag,  r,  c,  i,  j,  k  ; 
in[16],  dl,  d2,  d3,  d4,  d5  ; 
element  ; 


int 

FILE 

int 

int 

double 


Ioc2[2000][2],  Ioc3(2000][2]  ; 
*fsnd  ; 

sound,  point,  x[5],  y[5] ; 
max  _pta ; 
max ; 
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(and  =  (open  (word_number[pointer] ,  "r”) ; 

aound  =  0 ; 

i  =  0; 

flag  =  0 ; 

while  (flag  1=  1)  { 

(scant  ((and,  “%f‘,  &et*ment) ; 
if  (fec4(fsnd)  !=0) 

fl*g  =  1  ; 
alaelf  (I  >90) 

flag  =  1  ; 

etaa  { 

in(i]  =  (double)  element ; 
i+  +  ; 

> 

if  <(i  =  =  15)  &&  (flag  =  =  0))  { 

(  mindist  (t  map,  in,  &loc2(aound][0]) ; 

f-  0;  " 

sound + +  ; 

> 

> 

fclose  (fend)  ; 

for  (i  =  0  ;  i  <  sound  ;  i+  +)  { 

Ioc3[i][0]  =  Ioc2[i][0] ; 
loc3(i}[1]  «  loc2[i][1J  ; 

} 

max :_pts  =  sound  ; 


...  Trajectory  Reduction ... 

(or  (i  a  0;  i  <  j ;  i++)  { 

location[i][0]  =  Ioc2[i][0]  ; 
location[i][1]  =  loc2[ij[lj ; 

> 

length[0]  =  j ; 

for  (i  =  j ;  1  <  2000  ;  i+  +) 

location[i](1]  =  (localion[i][0]  =  -1)  ; 


f_mindist  ((  map,  inp,  close) 

double  inp[16]  ; 

in*  close(2]  ; 

float  f  map[20](20](16]  ; 

{ 

int  r,  c,  i ; 

double  dist ; 

double  minimum  =  99999  9  ; 

for  (r  =  0  ;  r  <  f_y size  ;  r+  +)  { 

for  (c  =  0  ;  c  <  f_xsiz*  ;  c+  +)  { 
dist  =  6.0 ; 

for  (i  =  0  ;  i  <  f_number_inputs  ;  i+  +) 

dist  +  =  pow  (inp(i]  -  f_map(r](c][i],  2.0) 
if  (dist  <  minimum)  { 

minimum  =  dist ; 
close(0]  =  c ; 
closejl)  =  r ; 

> 

} 
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$  link  twop«8c,nwin6b, options  fila/opt 

r 

tMtMMtMMMMtMMMMtHtMl  tWOpic8C.C  ******************** *****' 

This  routin*  finds  th*  closest  digit  (from  a  group  of  digits)  to 
sach  nods  in  a  sacond  Kohonan  not.  In  particular,  this  routina 
usss  100  x-y  pair  trajectories  filled  with  trailing  - 1  'a. 

For  aach  nods,  the  routina  searches  through  the  whole  list  for  th* 
digit  ‘closest’  to  that  node's  weight  'Closest'  In  this  case 
is  found  through  a  TAXI  distance. 

Data  output  includes  the  nod*  number,  distance  to  the  digit 
found  closest,  and  the  name  of  the  *  tm  file  of  the  digit. 


*/ 

#  include  math 

#  include  stdio 

#  include  time 


float 

map[20](20][100][2]  ;  /*  output  node*  */ 

double 

input[100](2] ;  /*  input  nodes  */ 

double 

node_dist ; 

int 

closest[2]  ;  /*  closest  node  */ 

int 

xsize,  ysize  ,  /*  Size  of  array  */ 

int 

numberjnputs ; 

char 

training_file[30],  temp_file[30],  first_n*t_fil*(30] 

char 

net_file(30] ; 

extern  int 

num  words  ; 

int 

mask  [20]  [20]  ; 

int 

map2  [20]  [20]  [1 00]  [2]  ; 

float 

aa  =  0.7S  ; 

float 

bb  =  0.75  ; 

extern  int 

f_xsi ze,  f_ysize ; 

extern  int 

location  [2000]  [2]  ; 

int 

innput[200][100][2]  ; 

extern  int 

length  [200]  ; 

extern  char 

word jiumber[200]  [1 5]  ; 

mindiat  (r,  c,  close) 


irrt 

r.  c ; 

int 

•close; 

int 

i,  sound  ; 

int 

compjength  ; 

double 

dist ; 

double 

minimum  =  9.99*31 

for  (sound  =  0  ;  sound  <  num_words  ;  sound  +  +)  { 
if  (length (sound]  >  mask(r][c]) 

compjength  =  length[sound]  ; 

else 

comp  length  =  mask[r][c]  ; 
diet  =  0.0 , 

for  (i  =  0  ;  i  <  comp_length  ;!++){ 

diet  +=  aba  (map2[r][c][i][0)  -  innput[sound][i][0])  + 
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aba  (map2[r][c][i](1]  -  innput[sound][i][1]) ; 

> 

i  (diet  <  minimum)  { 

minimum  =  diet ; 

•cloe*  =  sound ; 

> 

> 

nod*  dial  =  minimum  ; 

> 

main  0 

{ 

int  c ; 

printl  ("\nTWOPIC8c  (Closest  (taxi)  to  each  node:  100  wts/2-0  )...\n") ; 
map  speech  0  I 

> 

map  speech  0 

{ 

int  r,  c,  i,  j,  k,  x,  y  ; 

char  namejrj[30],  t*mp[30] ; 

int  loc ; 

FILE  *fnet,  *fk>g,  *fmask  ; 


printl  ("\nErrter  name  o(  pre-processor  Koh  net-file  (less  net]:  ") ; 

scanf  ("%s",  temp) ; 

apnntf  (firat_net_file,  "%s.net",  temp)  ; 

printf  ("Enter  name  of  header  file  containing  words  (less  hdr):  ")  ; 

scant  (“%*".  tempjile) ; 

sprirrtf  (trainingjile,  “%s.hdr",  tempjile)  ; 

printf  (“Enter  name  of  output  Koh  netjile  [less  .net]:  ”)  ; 

scanf  (“%a",  temp_file) ; 

sprirrtf  (net_file,  “%s.net",  temp_file)  ; 

sprirrtf  (temp,  "%s.msk“,  tempjile) ; 

fnet  =  fopen  (net_file,  “r") ; 

fscarrf  (fnet,"%d  %d  %d",  Aysize,  Axsize,  Anumber_inputs)  ; 
for  (r  =  0  ;  r  <  ysize  :  r+  +)  { 

for  (c  =  0  ;  c  <  xsize  :  c+  +)  { 

for  (i  =  0  ;  i  <  number Jnputs  ;  i  +  +  )  { 
fscarrf  (fnet,"  %d  %d",  Ax,  Ay) ; 
map2[r]  [c][i][0]  =  x  ; 
map2[r]{c](i][1]  =  y  ; 

} 

> 

} 

fclose  (fnet)  ; 

readjmjile  0  ; 

fmask  =  fopen  (temp,  “r")  ; 
for  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

for  (c  =  0  :  c  <  xsize  ;  c+  +)  { 

fscarrf  (fmask,  "%d",  Amask[r](c])  ; 

> 

} 

fclose  (fmask)  ; 
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twopteSe 


flog  =  (open  ("temp.log", "w") ; 
fprintf  (flog,  “TWOPtCSbAn')  ; 

fprintf  (flog,  “->  %e  ->  %e  ->\n",  fire»_net_file,  netjile) ; 
fprintf  (flog,  “Size  ie  %d  by  %d  nodee\n",  xsize,  ytize)  ; 

print!  (‘AnExpect  %d  cateulationsAn",  num_words)  ; 
tprintf  (flog,  "Expect  %d  catcuiationsAn”.  num_worda) ; 
print!  ('An Reeding  word:  ") ; 
for  (r  =  0  ;  r  <  num_words  ;  r+  +)  { 
print!  (“%d'\  r) ; 
getin  0  ; 

tor  (c  =  0  ;  c  <  number  Jnputs  ;  e+  +)  { 
innput[r](c][0]  =  location [c](oj ; 
innput[r][cj[lj  =  location [c](1] ; 

> 

> 

print!  (“Vn”)  : 

for  (r  =  0  ,  r  <  yaize  ;  r+  +)  { 

for  (c  =  0 ,  c  <  xaize  ,  c+  +)  { 
mindiat  (r,  c,  &loc) ; 

K  =  c  +  r  *  xsize  ; 

print!  (‘ViNode  %3d  :  word  #  %3d,  diet  =  %le  ", 
k.  loc,  node_dist) ; 
print!  {“(%a)",  word_number[loc])  ; 
fprintf  (flog,  ‘AnNode  %3d  :  word  #  %3d,  dist  =  %le  ", 
k,  loc,  node_dist)  ; 

fprintf  (flog,  “(%e)",  word  number[loc])  ; 

> 

> 

print!  ('AnCalc  illations  finished  An")  ; 

(close  (flog) ; 

} 


B-I60 


Appendix  B:  Computer  Programs 


$  link  codebk,  options  fils/opt 
f 

tMMMMMMtKMMMtnnnmt  codsbk.c 


Routine  to  gsnsrats  and  tast  an  untrained  second  Kohonen  net. 

An  untrained  net  is  generate  by  taking  stored  trajectories  from 
path.dal  and  storing  them  as  weights  in  respective  nodes.  That 
is,  the  first  row  are  assigned  the  zeros  through  to  the  last 
row  assigned  the  nines. 


A  test  set  of  digits  is  specified,  and  tested  using  DTW(maskQ, 
lengthQ).  AH  trajectories  are  lOOecaiars  filled  with 
trailing  0's. 


Q.  BARMORE1  Sep  88 

*/ 

#  include  math 

#  include  stdio 

#  include  stat 

int 

number  discretes ; 

irrt 

word  counter  ; 

int 

num  words ; 

char 

word_number[100][15]  ; 

int 

f_ysize,  f  xsize,  f  number  inputs  ; 

float 

f_map[20][20][16]  ; 

float 

map[20]  (20)  [225]  ;  /*  output  nodes  */ 

double 

input[225]  ;  /*  input  nodes  */ 

double 

node_dist ; 

int 

closest[2]  ;  /*  closest  node  */ 

int 

xsize,  ysize  ;  /*  Size  of  array  */ 

int 

number  Jnputs ; 

char 

training  file[30],  temp  file(30],  first  net  file[30) 

char 

net_file[30] ; 

int 

mask  [20]  [20]  ; 

int 

map2{20]  [20]  [  1 00]  [2]  , 

float 

aa  =  0.75 ; 

float 

bb  =  0  75  ; 

int 

length[200]  ; 

int 

location [2000]  [2]  ; 

mindist  (close) 

int 

{ 

int 

•close  ; 

r.  c  ; 

double 

dist  ; 

double 

minimum  =  9.99e31  ; 

for  (r  =  0  ;  r  <  ysiza  ;  r+  +)  { 

for  (c  =  0  ;  c  <  xsize  ;  c+  +)  { 

dtw  (&map2[r][c][0][0],  location,  mask[rj[c], 
length[0],  &dist)  ; 
if  (dist  <  minimum)  { 
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} 


} 


} 

nod*_di*t  =  minimum ; 


minimum  =  diet ; 
•doe*  =  c ; 

> 


mein  0 

{ 

int  c ; 


printf  ("VnCOOEBK:  Uee*  path.dat  as  codebook.  An")  ; 
map_speech  0  : 


map  speech  0 

{ 

int  r,  c,  i,  j,  k  ; 

char  nam*_trjl30],  temp[30] ; 

int  loc ; 

FILE  fnet,  flog,  fmask  ; 

printf  ("XnEnter  name  of  pre-processor  Koh  net-file  [less  net]:  ") 

scant  (“%s",  temp)  ; 

sprintf  (fir»t_net_file,  ‘ffcs.net",  temp)  ; 

printf  (“Enter  name  of  header  file  containing  words  (less  hdr):  ") 

scant  (“%a",  temp  file)  ; 

sprintf  (training_file,  "%s.hdr",  tempjile) ; 

readjm Jile  0  ; 

flog  =  fopen  (“temp.log", "w")  ; 

fprintf  (flog.  "CODEBK:  %s\n“,  namejrfl  ; 

fprintf  (flog,  “->  %8  ->  path.dat  ->\n",  first_net_file)  ; 

fprintf  (flog,  "Size  is  %d  by  %d  nodea\n",  xsiza,  ysize) ; 

printf  ('AnExpect  %d  calculationsAn",  num_words)  ; 
fprintf  (flog,  “Expect  %d  calculationsAn".  num_ words)  ; 
for  (r  =  0  ;  r  <  num_words  ;  r+  +)  { 
getin  0  . 
mindist  (&loc)  ; 

printf  ("Word  %3d  is:  %3d\n“,  r,  loc)  : 
fprintf  (flog,  “Word  %3d  is:  %3d\n“,  r,  loc)  ; 

> 

printf  ('AnCalculations  finishedAn")  , 
fclose  (flog) ; 


dtw  (template,  utterance,  tjength,  ujength,  ave_dist) 
int  template[200][2],  utter ance[200) [2]  : 

int  tjength,  ujength  ; 

double  *ave  diet ; 

{ 

float  back  path[2][200]  ; 

int  b_p(2][20Q]  ; 

int  r,  c  ; 
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diet  =  0.0 ; 
b_ptr  =  1  ; 
b_Pl0][01  =  1  ; 

ter  (r  =  1  ;  r  <  tjength  ;  r+  +) 

b_p[0]lr]  =  b_p[0Hr-1]  +  1  ; 
for  (r  =  0  ;  r  <  tjength  ;  r+  +)  { 

back_path(0](r]  =  (diet  +  =  bb  * ( 

abe(utterance[0][0]  -  t«mplate[r]{0])  + 
abe(utterance[0][1]  -  template[r](1])))  ; 

> 

for  (c  =  1  ;  c  <  ujength ;  c+  +)  { 
if  (b _ptr  ==0)  { 

b _ptr  =  1  ; 
ptr  =  0 ; 

> 

else  { 

bjJtr  =  0 ; 
ptr  =  1  ; 

> 

for  (r  =  0  ;  r  <  tjength  ;  r+  +)  { 

diet  =  abe(utterance[c][0]  -  template[r][0])  + 
abs(utterance[cj(1]  -  template[rj[1])  ; 
if  (r  ==  0){ 

back  jaeth  [ptr]  [r]  =  back_path[b_ptr][r]  + 
(aa  *  diet) ; 

b_p[pt r][r]  =  bjs[b_ptr][r]  +  1  , 

} 

else  { 

dl  =  back _path[b_ptr][r-l]  +  dist ; 
d2  =  backjjath[ptr][r-l]  +  (bb  *  dist) ; 
d3  =  back  path[b_ptr][r]  +  (aa  *  dist) ; 
if(d2<=d3&&d2<  dl){ 

back_path(ptr][r]  =  d2  ; 
bj3[ptr][r]  =  b_p[ptr][r-1]  +  1  ; 

> 

else  if  (d3  <  =  d2  &&  d3  <  dl)  { 
back_path[ptrj[r]  =  d3  ; 
b_p(ptr][r]  =  bjj[b_ptr][r]  +  1  ; 

} 

else  { 

back_path[ptr][r]  =  dl  ; 
b_Plptr][r)  =  b_p[b_ptr)[r-1)  +  1  ; 
> 

> 

> 

> 

*ave  dist  =  back  path[ptr][t  length-1]  /  b  p[ptr][t  length-1]  ; 

> 


read  tm  file  0 

{ 

RLE 

♦tf,  fnet ; 

int 

j,  i.  r,  c  ; 

int 

temp,  k,  number 

tf  =  fopen  (trainingjile,  "r")  ; 
fscanf  (tf,  "%d",  &num_  words) ; 
for  (i  =  0  ;  i  <  num_ words  ;  i+  +) 


B-168 


Appendix  B:  Computer  Programs 
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> 


fscanf  (tf,  "%e".  word_number[i])  ; 

fcloee  (tf)  ; 

♦net  =  (open  (first_net_file,  “r") ; 

tacent  (fnet,"%d  %d  %d",  Srfjyeize,  Mjisize,  M_number  Jnputs) ; 

for  (r  =  0  ;  r  <  f_y«ize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  f_xsize  ;  c+  +)  { 

for  (i  =  0 ;  i  <  f  number_input«  ;  i-t-  +)  { 

fscanT (fnet,"  %f\  &f  map[r)[c)[il) ; 

> 

} 

} 

fcloee  (fnet) ; 

ysize  =  (xsize  =  10) ; 

number  Jnputa  =  100  ; 

fnet  =  fopen  ("path.dat",  “r") ; 

fecenf  (fnet,  “%d",  &num_word») ; 

for  (r  =  0  ;  r  <  yeize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  xsize  ;  c+  +)  { 

for  (i  =  0  ;  i  <  number Jnputs  ;  i+  -*-)  { 

fecenf  (fnet,"  %le",  &map[r)[c)[i)) ; 

> 

> 

} 

fcloee  (fnet)  ; 

for  (r  =  0  ;  r  <  yeize  ,  r+  +)  { 

for  (c  =  0  ,  c  <  xeize  ;  c+  +)  { 
number  =  0 ; 

for  (i  =  0  ;  i  <  number  jnputs  ;  i+  +)  { 
if  (map[r][c][ij  >  5.0e-4) 
number ++  ; 

temp  =  (int)  (map[r][c)(i]  *  226.0  -10); 
k  =  temp  %  f  jteize  ; 
map2[r][c)[i)[1)  =  (temp  -  k)  /  f_xsize  ; 
map2[r]lcj[i][0]  =  k  ; 

> 

mask[r](c]  =  number ; 

} 

> 

word  counter  =  0  ; 


getin  0 

{ 

if  (word_counter  =  =  num_ words) 
word_counter  =  0 ; 
read_word  (word_counter) ; 
word_counter++  ; 


read_word  (pointer) 

int  pointer ; 

{ 

int  flag,  r,  c,  i,  j,  k  ; 

double  in(181,  d1,d2,  d3,  d4,  d5  ; 

float  element ; 
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int  Ioc2[2000][2],  toe3[2000][2] ; 

FILE  *fend; 

int  sound,  point,  x[5],  y[5] ; 

int  max_pta ; 

doubts  max ; 

for  (i  =  0  ;  i  <  number Jnpute  ;  i+  +) 
input(i]  =  0.0 ; 

tend  =  fopen  (word_number  [pointer] ,  "r”) ; 

sound  =  0 ; 

i  =  0; 

flag  -  0 ; 

while  (flag  1=  1)  { 

(scant  (fend,  “%f\  &  element)  ; 
if  (feof(tend)  1=0) 
flag  =  1  ; 
else  it  (i  >  99} 

flag  =  1  ; 

else  { 

in[i]  =  (double)  element ; 

i  +  +  ; 

} 

if  ((i  ==  15)  &&  (flag  ==  0))  { 

f  mindiet  (f  map,  in,  &loc2(soundl(0]) ; 

f=  0  ; 

sound+  +  ; 

} 

} 

(close  (fend)  ; 

tor  (i  =  0  ;  i  <  sound  ;  i+ +)  { 

Ioc3[i][0]  =  Ioc2[i][0] ; 

I°c3[i) 1 1  ]  =  loc2[i][1]  ; 

> 

max _pts  =  sound  ; 

...  Trajectory  Reduction ... 

for  (i  =  o  ;  i  <  j ;  i++)  { 

location  [i][0]  =  Ioc2[i][0]  ; 
location[ij[lj  =  loc2(i](1]  ; 

} 

length[0]  =  j  ; 

for  (i  =  j  ,  i  <  200  ;  i++) 

location[i][1]  =  (location[i][0]  =  0)  ; 


f_mindist  (f  map,  inp,  close) 

double  inp[16]  ; 

int  close[2]  ; 

float  f  map[20][20][16]  ; 

{ 

int  r,  c,  i ; 

double  diet ; 

double  minimum  =  9.99e31  ; 

for  (r  =  0  ;  r  <  f_ysue  ;  r+  +)  { 

for  (c  =  0  ;  c  <  f_xsize  ;  c+  +)  { 
diet  =  0.0 ; 

for  (i  =  0  ;  i  <  f_number_inputs  ;  i+  +) 
dist  +  =  pow  (inp[i]  -  f_map(r][c](i],  2.0)  ; 


1 


1 


.  a 


« 


« 
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if  (diet  <  minimum)  { 

minimum  =  diet ; 
c!ose(0]  =  c ; 
closejl]  =  r ; 

> 

> 


codebk 
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$  link  codebkb, options  file/opt 
f 

nMwnmMMmntHiMMtnM  COdSbkb.C  *•**»*»**«•*«***»****•*••* 

Routins  to  gansrats  and  test  an  untrained  second  Kohonen  net. 

An  untrained  net  is  generate  by  taking  stored  trajectories  from 
pathold.dat  and  storing  them  as  weights  in  respective  nodes.  That 
is,  the  first  row  are  assigned  the  zeros  through  to  the  last 
row  assigned  the  ninee. 


A  test  set  of  digits  is  specified,  and  tested  using  QTWfmaakQ, 
lengthQ).  All  trajectories  are  75  scalars  filled  with 
trailing  0's. 


V 
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#  include  math 

#  include  stdio 

#  include  stat 

int 

number  discretes  ; 

int 

word  counter ; 

int 

num  words  ; 

char 

word  numberf  1 00]  [  1 5]  ; 

irrt 

f_ysize,  f  xsize,  f  number  inputs  ; 

float 

f_map[20][20][16] ; 

float 

map[20][20][225]  ;  /*  output  nodes  */ 

double 

input[225] ;  /*  input  nodes  */ 

double 

nodedist ; 

int 

closest[2]  ;  /*  closest  node  V 

int 

xsize,  ysize  ;  /*  Size  of  array  */ 

int 

numberjnputs  ; 

char 

training_file[30],  temp_file(30J,  first_net_file[30] 

char 

net_file[30]  ; 

int 

mask  [20]  [20]  ; 

int 

map2[20]  [20]  (100]  (2]  ; 

float 

aa  =  0.75  ; 

float 

bb  =  0.75 ; 

int 

length(200)  ; 

int 

location[2000][2]  ; 

mindist  (close) 

int 

{ 

int 

•close ; 

r.  c  ; 

double 

diet ; 

double 

minimum  =  9.99e31  ; 

for  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

tor  (c  =  0  ,  c  <  xsize  ,  c+  +)  { 

dtw  (&map2[r][c][0](0],  location,  mask[r][c], 
length[0]  &dist)  , 
if  (diet  <  minimum)  { 
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} 


> 


> 


node_di*t  =  minimum ; 


main  0 

{ 

int  c ; 


minimum  =  diet ; 
•cloae  =  c ; 

} 


printf  (“\nCOOEBKb:  Usea  pathotd.dat  as  codebook... \n’") ; 
map_apeech  0  ; 


map  speech  0 

{ 

int  r,  c,  i,  j,  k  ; 

char  name_trj[30],  temp[30] ; 

int  loc ; 

FILE  *fnet,  *flog,  *fmask  ; 


print!  ("\nEnter  name  ot  pre-processor  Koh  net-file  [less  net]  :  ”)  ; 

scant  ("%a“,  temp) ; 

sprintf  (firstnetjile,  "%a.n*t“,  temp) ; 

printf  ("'Enter  name  of  header  file  containing  words  (less  .hdr):  ")  ; 

scant  ("%s”,  temp_file)  ; 

sprint!  (training_file,  “%s.hdr“,  temp_file)  ; 

read_trn_file  0  ; 

flog  =  fopen  ("1emp.log", "w") ; 

fprintt  (flog,  “CODEBKb:  %s\n",  namejrj)  ; 

fprintf  (flog,  “->  %s  ->  path.dat  ->\n",  first_net_file)  ; 

f printf  (flog,  "Size  is  %d  by  %d  nodes\n",  xsize,  ysize) ; 

printf  (“\nExpect  %d  calculationsAn".  num_words)  ; 
fprintf  (flog,  “Expect  %d  calculationsAn  ",  num_words)  ; 
for  (r  =  0  ;  r  <  num_worda  ;  r+  +)  { 
getin  0  ; 
mindist  (&loc) ; 

printf  (  "Word  %3d  is:  %3d\n“,  r,  loc)  ; 
fprintf  (flog,  “Word  %3d  is.  %3cf\n  ",  r,  loc) ; 

} 

printf  OnCaJculations  finishedAn")  ; 
fclose  (flog)  ; 


dtw  (template,  utterance,  t_length,  ujength,  ave_dist) 
int  template(200][2],  utterance[200][2]  ; 

int  tjength,  ujength ; 

double  *ave  diet ; 

{ 

float  back_path[2]  [200]  ; 

int  b_p[2][200]  ; 

int  r,  c  , 

int  ptr,  b  ptr  ; 

float  dl,  d2.  d3,  dist ; 
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diet  =  0.0 ; 
b_ptr  =  1 ; 
b_p[0JI0]  =  1  ; 

for  (r  =  1  ;  r  <  t  length  ;  r+  +) 

b_p[0ftr]  =  b_p[01tr-1]  +  1  ; 
for  (r  =  0 ;  r  <  tjength  ;  r++)  { 

back_path[0](r]  =  (diet  +  =  bb  *  { 

abe (utterance [0]  [0]  •  template[r][0J)  + 
abe(utterance[0][1]  •  template[rj[1])))  ; 

> 

for  (c  =  1  ;  c  <  u  length  ;  c+  +)  { 
if(b_ptr"==0){ 

b_ptr  =  1  ; 
ptr  =  0; 

} 

efee{ 

bjjtr  =  0 ; 
ptr  =  1  ; 

} 

for  (r  =  0  ;  r  <  tjength  ;  r+  +)  { 

diet  =  abe(utterance[c}(0)  -  temptate[r][0])  + 
abs(utterance[c][1]  •  template[rJ[1J) ; 
if(r==0){ 

back_path]ptr][r]  =  beck_p*th[b_ptr][r]  + 
(aa  *  dial) ; 

b_p(ptr][r]  =  b_p[b_ptr]{r]  +  1  ; 

> 

else  { 

dl  =  back_path[b_ptr](r-1]  +  diat ; 
d2  =  back_path[ptrj(r-1)  +  (bb  *  diat)  ; 
d3  =  back_path[b_ptr)(rl  +  (aa  *  diat)  ; 
if  (d2  <  =  d3  &&  d2  <  d1){ 

back_path(ptrHr)  =  d2 ; 
b_p[ptr]{r]  =  bjj(ptr][r-1]  +  1  ; 

> 

else  if  (d3  <  =  d2  &&  d3  <  dl)  ( 
back_path(ptr][r]  =  d3 ; 
b_p(ptr](rj  =  b_p(b_ptrj[rj  +  1  ; 

> 

else  { 

back_path[ptr][r]  =  dl  ; 
b_p(ptr][r]  =  b_p[b_ptr][r-1]  +  1  ; 
} 

} 

> 

} 

*ave  diat  =  back_path[ptr][t  length-1]  /  b  p(ptr][t  length-1] ; 

} 


read  tm  file  0 

{ 

FILE 

*tf,  *fnet ; 

int 

j,  i,  r,  c  ; 

int 

temp,  k,  number 

tf  =  fopen  (training_file,  "r")  ; 
facanf  (tf,  “%d",  &num_words)  ; 
for  (i  =  0  ;  i  <  num_worda  ;  i++) 
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(scant  (it,  word_number[i]) ; 

(close  (tf) ; 

(net  =  (open  (flrst_net_tile,  *¥)  ; 

(scant  (fn*t,"%d  %d  %d",  4(_ysize,  &f_xsiz*.  Mnumber Jnputs) ; 
(or  (r  =  0 ;  r  <  f_ystze ;  r++){ 

(or  (c  =  0 ;  c  <  t_x size ;  c+  +)  { 

tor  (i  *  0  ;  i  <  t_r>umberjnputs  ;!++){ 

fscanT  ((net,"  %f",  &f_map[r][c)[il) ; 

> 

> 

} 

tcloee  (fnet) ; 

ysize  =  (xsiz*  =  10) ; 
number _inputs  =  75  ; 

(net  =  (open  ("pathold.dat",  “r") ; 

(scant  (fnet,  “%d",  &num_words) ; 

(or  (r  =  0 ;  r  <  ysize  ;  r+  +)  { 

(or  (c  =  0  ,  c  <  xsiz*  ;  c+  +)  { 

for  (i  =  0  ;  i  <  number Jnputs  ;  i  +  +)  { 

(scant  (fnet,"  %le",  &map(r][c][i])  ; 

> 

> 

> 

(close  (fnet) ; 

for  (r  =  0  ;  r  <  ysize  ,  r+  +)  { 

(or  (c  =  0  ;  c  <  xsize  ;  c+  +■)  { 
number  =  0 ; 

for  (i  =  0  ;  i  <  number  Jnputs  ;  (++)  { 
i(  (map[r][c][i]  >  S.0e-4) 
number*  +•  ; 

temp  =  (int)  (map(r][c](i]  *  225.0)  ; 
k  =  temp  %  f_xsiz*  ; 
map2(r][c)(i][l]  =  (temp  •  k)  /  f_xsize 
map2[r](c)(il(0)  =  k  ; 

> 

maak(r](c]  =  number ; 

> 

> 

word  counter  =  0  ; 

> 

getin  0 

{ 

if  (word_counter  =  =  num_words) 
word_cour»ter  =  0  , 
read_word  (word_counter)  ; 
word  counter ++  ; 

> 

read_word  (pointer) 

int  pointer ; 

{ 

int  flag,  r,  c,  i,  j,  k  ; 

double  in(16],  dl,  d2,  d3,  d4,  d5  ; 

dost  element ; 
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int  (oc2[2000](2],  Ioc3[2000][2] ; 

FILE  fend ; 

int  sound,  point,  x[S],y[S] ; 

int  max_pts ; 

double  mex ; 

for  (I  =  0 ;  i  <  number_inputs ;  i+  +) 
input(i]  =  0.0 ; 

(and  =  (open  (word_number[pointer],  “r") ; 
sound  =  0 ; 
i  =  0; 

(lag  =  0 ; 
while  (flag  1=  1)  { 

(scant  (tend,  "%T,  ^element) , 
if  (faot(tsncl) !  =0) 
flag  *  1 ; 
else  if  (i  >  99) 

flag  -  1 ; 

else  { 

in[i]  =  (double)  element ; 
i++  ; 

} 

if  ((i  ==  15)44  (flag  =  =0)){ 

f  mindiat  (f  map,  in,  &loc2[sound][0)) ; 

f=  0 ; 

sound  +  +  ; 

> 

> 

fclose  (fsnd) ; 

for  (i  =  0  ;  i  <  sound  ;  i+  r-)  { 

Ioc3[il[0]  =  Ioc2(i][0]  ; 
loc3(i][11  =  loc2(i][1] ; 

} 

max  jits  =  sound  ; 

...  Trajectory  Reduction ... 

for  (i  =  0  ;  i  <  j ;  i++)  { 

location[i)[0]  =  Ioc2[i][0]  ; 
location(ij(lj  =  loc2[i][1)  ; 

lengthfOJ  =  j ; 

for  (i  =  j ;  i  <  200  ;  i  +  +) 

location[i][1J  =  (location^]  [0]  =  0) ; 


f_mindist  (f_map,  inp,  close) 

double  inp(16)  ; 

int  close[2]  ; 

float  f  map(20K20][16] ; 

{ 

int  r,  c,  i ; 

double  dist ; 

double  minimum  =  9.99e31  ; 

for  (r  =  0  ;  r  <  f_ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  f_xsize  ;  c+  +)  { 

dist  =  5.0 ; 

for  (i  =  0  ;  i  <  f_number  Jnputs  ;  i  +  +  ) 

dist  +  =  pow  (inpfij  -  f_map(rj[cj[i],  2.0) 
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codabkb 


jf  (diet  <  minimum)  { 

minimum  =  dist  ; 
cIom[0]  =  c ; 
cioaaflj  =  r ; 

> 
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$  Unk  codebk2,options  file/opt 

r 


codebk2 


'  codebk2.c ' 


Routine  to  generate  and  teet  an  untrained  second  Kohonen  net 

An  untrained  net  is  generate  by  taking  stored  trajectories  from 
path.dat  and  storing  them  as  weights  in  respective  nodes.  That 
is,  the  first  row  are  assigned  the  zeros  through  to  the  last 
row  assigned  the  nines. 

A  teet  set  of  digits  «  specified,  and  tasted  using  TAXI  distance. 
All  trajectories  are  100  scalars  filled  with  trailing  0‘s. 

Q  BARMORE1  Sep  88 


#  include  math 

#  include  stdio 

#  include  slat 


float 

double 

double 


mindi8t  (close) 
int 

{ 

int 

double 

double 


number_discretea ; 
word_counter ; 
num_worde ; 
word_number[  1 00]  [  1 5]  ; 

f_ysize,  1  xsize,  f  number  inputs  ; 
f_map[20][20][16]  ; 

map[20]  [20]  [225]  ;  /*  output  nodes  */ 
input[225] ;  /•  input  nodes  */ 
nodedwt ; 

closest[2)  ;  /*  closest  node  */ 
xsize,  ysize  ;  /*  Size  of  array  V 
number Jnputs  ; 

training_file(30],  temp_file(30],  first_net_file(30]  ; 
netjile(30]  ; 

mask  [20]  [20] ; 
map2[20][20][100][2]  ; 
aa  =  075 ; 
bb  =  0.75  ; 
length  [200] ; 
k>cstion[2000][2] ; 


•close ; 

i,  r,  c  ; 

diet ; 

minimum  =  9.99e31  ; 


for  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  xsize  ;  c+  +)  { 
diet  =  0  0  ; 

for  (i  =  0  ;  i  <  number  Jnputs  ;  i  +  +)  { 

diet  +=  abs(map2[r][cj[i][0]-location[i][0])  + 
abs(map2[r][c][i][1]-location[i][1])  ; 
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codebk2 


> 


} 

if  (diet  <  minimum)  { 

minimum  =  diet ; 
•does  =  c ; 


> 


> 


node_diat  =  minimum ; 


} 


main  0 

{ 

ini  c ; 


print}  ("AnCODEBK:  Usee  path.dat  as  codebook..  An") ; 
map_speech  Q  I 


map  speech  0 

{ 

int  r,  c.  i,  j,  k  ; 

char  name_trj[30],  temp[30] ; 

int  loc ; 

FILE  *frtet,  *fkjg,  *fmask  ; 


printf  (“\nEnter  name  of  pre-processor  Koh  net-file  {lees  net):  ")  ; 

scant  (“%e ",  temp)  ; 

sprintf  (first_net_file,  "%e.net",  temp)  ; 

printf  ("Enter  name  of  header  file  containing  words  (less  hdr):  "] ; 

scanf  (“%s",  tempjile) ; 

sprintf  (trainingjile,  "%s.hdr",  temp_tile)  ; 

read_tmjile  0  ; 

flog  =  (open  (“temp.log","w")  ; 

fprintf  (flog,  "COOEBK:  %a\n",  name_trj)  ; 

fprirrtf  (flog,  “->  %e  ->  path.dat  ->\n ",  first_net_file)  , 

fprintf  (flog.  "Size  is  %d  by  %d  nodes\n",  xsize,  ysize)  ; 

printf  (“\nExpect  %d  calculationsAn",  num_ words)  ; 
fprintf  (flog,  “Expect  %d  calculationsAn",  num_ words)  ; 
for  (r  =  0  ;  r  <  num_words  ;  r+  +)  { 
getin  0  : 
mindist  (&loc)  ; 

printf  (“Word  %3d  is:  %3d\n",  r,  loc)  ; 
fprintf  (flog,  ‘Word  %3d  is.  %3d\n  ",  r,  loc)  ; 

> 

printf  ('An Calculations  finished. vn  )  ; 
fclose  (flog)  ; 

> 


read  tm  file  0 

{ 

FILE 

*tf,  *fnet ; 

int 

j,  i,  r,  c  ; 

int 

temp,  k,  number ; 

tf  =  fopen  (training_file,  "r")  ; 
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fscanf  (tf,  “%d",  Anum_words) ; 
for  (i  =  0 ;  i  <  num_word*  ;  i+  +) 

fecanf  (tf, "•%*",  word_number[i]) ; 
feioee  (tf) ; 

fnet  =  fopen  (first_net_fHe,  “r”) ; 

fscenf  (fnet,  ”%d  %d  %d",  Af_ysize,  Afjcsize,  Af_number  Jnputs) ; 
for  (r  *  0 ;  r  <  f_yeize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  f_xsiz*  ;  c+  +)  { 

for  (i  =  0 ;  i  <  f_numb*rjnput* ;  i++){ 

fecenf  (fnet,”  XT,  Af  m*p[r][c][i]) ; 

} 

> 

> 

feioee  (fnet)  ; 


ysiz*  =  (xsize  =  10) ; 
number  Jnputs  =  100  ; 

fnet  =  fopen  ("pathdat",  “r ")  ; 
fscanf  (fnet,  “%d",  Anum_worde)  ; 
for  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  xsize ;  c+  +)  { 

for  (i  =  0 ;  i  <  number  Jnputs  ;  i+  +)  { 

fscanf  (fnet,”  %le".  Amap[r][c](i])  ; 

> 

> 

} 

fclose  (fnet) ; 

for  (r  =  0  ;  r  <  ysize  ;  r++)  { 

for  (c  =  0  ;  c  <  xsize  ;  c+  +)  { 
number  =  0 ; 

for  (i  =  0  ;  i  <  numberjnputs  ;  i+  +)  { 
if  (map[r][cl[i]  >  5.0*-4) 
number ++  ; 

temp  =  (int)  (map[r](c]{il  *  226.0  - 1.0)  ; 
k  =  temp  %  f_xsize  ; 
map2[r](c][i]l1)  =  (temp  •  k)  /  f_xsize  ; 
map2[r)[c)[i][0)  =  k ; 

> 

mask[r][c]  =  number ; 

> 

} 

word  counter  =  0  ; 

} 

getin  0 

{ 

if  (word_counter  =  =  num_words) 
word_counter  =  0 ; 
read_word  (word_counter)  ; 
word  counter  +  +  ; 

} 

read  word  (pointer) 

int  pointer ; 

( 

int  flag,  r,  c,  i,  j,  k  ; 

double  in[16J,  dl,  d2,  d3,  d4,  d5  ; 
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float  element ; 

int  k>c2[2000][2],  Ioc3[2000][2]  ; 

FILE  fend; 

int  sound,  point.  x[5],  y[5] ; 

int  max_ptt ; 

doubt*  max ; 

for  (I  =  0  ;  i  <  number Jnputs  ;  if-  +) 
input{i]  =  0.0 ; 

fend  =  fopen  (word_number  [pointer] ,  “r") ; 

sound  =  0 ; 

i  =  0; 

flag  =  0 ; 

while  (flag  1=  1)  { 

fscanf  (fsnd,  “%f',  &element)  ; 
if  (f*of(fsnd)  1=0) 
flag  =  1  ; 
els*  if  (i  >  99) 

flag  =  1  ; 

else  { 

in[i]  =  (double)  element ; 
i++  ; 

} 

if  ((i  ==  15)  &&  (flag  ==  0))  { 

fmindist  (f  map,  in,  &loc2[sound][0])  ; 
i”=  0 ; 
sound  +  +  ; 

> 

> 

fclose  (fsnd) ; 

for  (i  =  0  ;  i  <  sound  ;  i++){ 

Ioc3[i][0]  =  Ioc2[i][0]  ; 
loc3[i][1]  =  loc2[i][1] ; 

} 

maxjpts  =  sound ; 

...  Trajectory  Reduction ... 

for  (i  =  0  ;  i  <  j ;  i+  +)  < 

location  [i][0]  =  Ioc2[i][0] ; 
location[i][lj  =  loc2[i][1] ; 

> 

length(0]  =  j ; 

for  (i  =  j ;  i  <  200  ;  i+  +) 

k>cation[i][1]  =  (location[i](0]  =  0)  ; 


f_mindist  (f_map,  inp,  close) 

double  inp[16] ; 

int  close[2]  ; 

float  f  map[20][20](16]  ; 

{ 

int  r,  c,  i ; 

double  diet ; 

double  minimum  =  9.99e31  ; 

for  (r  =  0  ;  r  <  f_ysi2e  ;  r+  +)  { 

for  (c  =  0  ;  c  <  f_xsize  ;  c-i-  +)  { 
diet  =  6.0 ; 
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for  (i  =  0  ;  i  <  f_number  Jnputi ;  i+  +) 

diet  +=  pow  (inp{i]  -  f_m*p[r][cl[i],  2,0) ; 
if  (diet  <  minimum)  { 

minimum  =  diet ; 
cloee[0]  =  c ; 
cloeejl]  =  r ; 

> 
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$  link  codebk2b, options  tile/opt 
/* 

.................................  oodebk2b.c 


Routine  to  gene? ate  and  teat  an  untrained  second  Kohonen  net. 


An  untrained  net  is  generate  by  taking  stored  trajectories  from 
pathokf.dat  and  storing  them  as  weights  in  respective  nodes.  That 
is,  the  first  row  are  assigned  the  zeros  through  to  the  lest 
row  assigned  the  nines. 

A  test  set  of  digits  is  specified,  and  tested  using  TAXI  distance. 

All  trajectories  are  75  scalars  filled  with  trailing  0's. 

*/ 

Q.  BARMORE1  Sep  88 

#  include  math 

#  include  stdio 

#  include  stat 

•nt 

number  discretes ; 

int 

word  counter ; 

int 

num  words  ; 

char 

word_number[l00][l5]  , 

int 

f_ysize,  f  xsize.  f  number  inputs  ; 

float 

f_map[20]  (20]  [  1 6]  ; 

float 

map[20] (20)  [225] ;  /*  output  nodes  */ 

double 

input[225] ;  /*  input  nodes  */ 

double 

node_dist ; 

int 

closest[2] ,  /*  closest  node  */ 

int 

xsize,  ysi2e  ,  /*  Size  of  array  V 

int 

number  Jnputs  ; 

char 

training_(ile[30],  temp_lile(30],  first_net_file[30)  ; 

char 

net_file(30]  ; 

int 

mask  [20]  (20]  ; 

int 

map2[20]  [20]  [1 00]  [2]  ; 

float 

aa  =  0.75  ; 

float 

bb  =  0.75  ; 

int 

length(200]  ; 

int 

location[2000][2]  ; 

mindist  (close) 

int 

{ 

int 

•close ; 

i,  r,  c  ; 

double 

diet ; 

double 

minimum  =  9.99e31  ; 

for  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  xsize ;  c+  +)  { 
dist  =  0.0 ; 

for  (i  =  0  ;  i  <  numberjnputs  ;  i+  +)  { 

dist+ =abs(map2[r]tc](i][0]-locstion[i][0])  + 
abe(map2[r][cJ[i](1]-location(i][t]) ; 


Appendix  B:  Computer  Program 


codebk2b 


> 


> 

if  (diet  <  minimum)  { 

minimum  =  diet ; 
•close  =  c ; 

} 

> 

> 

node  dist  =  minimum ; 


mein  0 

{ 

int  c ; 


print!  ("\nCODEBK2b:  Usee  pathdd.dat  &  TAXI  ..An") ; 
mapspeech  Q  I 


map  speech  Q 
{ 

int 

r,  c,  i,  j,  k  ; 

char 

name_trj(30],  temp(30] 

int 

loc  ; 

FILE 

*fnet,  *flog,  *fmask ; 

printf  ("\nEnter  name  of  pre-processor  Koh  net -file  [less  .net]:  ") ; 
scant  ("%a",  temp) ; 
s printf  (first_net_file,  “%s.net",  temp) ; 

printf  (“Enter  name  of  header  file  containing  words  (less  hdr): ") ; 

scanf  (“%s",  temp_file)  ; 

sprint!  (training_file,  "%a.hdr",  tempjile) ; 


read  tm  file  0  ; 

flog  =  fopen  (“temp.log", "w”)  ; 
f printf  (flog,  “CODEBKb:  %s\n",  namejrj)  ; 
fprintf  (flog.  "->  %8  ->  path.dat  ->\n",  first _net_file)  ; 
fprintf  (flog,  "Size  is  %d  by  %d  nodes\n xsize,  ysize)  ; 

printf  ('AnExpect  %d  calculationsAn",  num_words)  ; 
fprintf  (flog.  "Expect  %d  calculationsAn",  num_words)  ; 
for  (r  =  0  ;  r  <  num_words  ;  r++)  { 
getin  0  ; 
mindist  (&loc)  ; 

printf  (“Word  %3d  is:  %3d\n”.  r,  loc)  ; 
fprintf  (flog,  "Word  %3d  is:  %3cf\n”,  r,  loc)  ; 

} 

printf  ('AnCalculations  finishedAn")  ; 
fclose  (flog)  ; 

} 


read  tm  file  0 

{ 

FILE 

*tf,  *fnet ; 

int 

j,  i,  r,  c  ; 

int 

temp,  k,  number ; 

tf  =  fopen  (training_file,  “r")  ; 
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fsceflf  (tf,  "%d”,  &num_worde) ; 
for  (I  =  0  ;  i  <  numword*  ;  i+  +) 

fecenf  (tf,  “%e",  word  number(i])  ; 
fdoee  (tf) ; 

fnet  =  fopen  (first_net_file,  “r")  ; 

fecertf  (fnet,"%d  %d  %d",  &f Jysi ze,  &t_xsize,  &f_number_inpute) ; 
for  (r  =  0  ;  r  <  f_ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  f_xeize  ;  c+  +)  { 

for  (i  =  0  ;  i  <  f_number  input*  ;  i+  +)  { 

fscanf  (fnet,"  %f",  &f  map[r][c][i]) ; 

> 

> 

> 

feiose  (fnet)  ; 

ysize  =  (xsize  =  10) ; 
number Jnputs  =  75  ; 

fnet  =  fopen  ("pathold.dat",  "r")  , 
fecenf  (fnet,  “%d",  &num_worda)  ; 
for  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  xsize  ;  c+  +)  { 

for  (i  =  0  ;  i  <  numb*r_inputs  ;  i  +  +)  { 

fecenf  (fnet,"  %le",  &map[r][c][i])  ; 

> 

} 

> 

fefose  (fnet)  ; 

for  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  xaize  ;  c+  +)  { 
number  =  0 ; 

for  (i  =  0  ;  i  <  number  Jnputs  ;  i  +  +  )  { 
if  (map(r][c](i]  >  5.0e-4) 
number ++  ; 

temp  =  (int)  (mep[r](c)lil  *  225.0)  , 
k  =  temp  %  f_xsize  ; 
map2[r][c](i](l]  =  (temp  -  k)  /  f_xsize  ; 
m*p2[r](c](ij{0]  =  k  ; 

} 

mask(r][c]  =  number ; 

> 

> 

word  counter  =  0  ; 

} 

getin  0 

{ 

if  (word_counter  =  =  num_words) 
word_counter  =  0  ; 
read_word  (word_counter)  ; 
word_counter+  +  ; 


read_word  (pointer) 

int  pointer ; 

int  flag,  r,  c,  i,  j,  k  ; 

double  in(16],  dl,  d2,  d3,  d4,  d5  ; 
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float  element ; 

int  Ioc2[2000][2],  Ioc3[2000][2]  ; 

RLE  'tend ; 

int  sound,  point,  x(5],  y[5]  ; 

int  max_pts ; 

double  max ; 

tor  (i  =  0  ;  i  <  number Jnputs  ;  i+ +) 
input[i]  =  0.0 ; 

fend  =  (open  (word_number[pointer],  "r")  ; 

sound  =  0 ; 

i  =  0; 

flag  =  0 ; 

while  (flag  !=  1)  { 

fscanf  (fend,  “%f",  &element)  ; 
if  (feof (fend)  !  =0) 
flag  =  1  ; 
else  if  (i  >  99) 

flag  =  1  ; 

else  { 

in[i]  =  (double)  element  ; 
i  +  +  ; 

} 

if  ((i  ==  15)  &&  (flag  ==0))  { 

f_mindi8t  (f  map,  in,  &loc2[sound]{0])  ; 
i  =  0  ; 
sound  ++  ; 

} 

} 

fclose  (fend)  ; 

for  (i  =  0  ;  i  <  sound  ;  i+  +)  { 

Ioc3[i][0]  =  loc2[i]  [0]  ; 
loc3(i](1]  =  loc2[i][1j  ; 

} 

max_pta  =  sound  ; 

...  Trajectory  Reduction  ... 

for  (i  =  0  ;  i  <  j  ;  i+  +)  { 

location[i][0]  =  Ioc2[i][0]  ; 
location[ij(lj  =  loc2(i](li  , 

} 

length[0]  =  j ; 

for  (i  =  j ;  i  <  200  ;  i  +  +) 

location[i)[1]  =  (location[i](0]  =  0)  ; 


f_mindist  (f_map,  inp,  close) 

double  inp(16]  ; 

int  close{2]  ; 

float  »_map[20][20)[16)  ; 

{ 

int  r,  c,  i  ; 

double  dist ; 

double  minimum  =  9  99e31  ; 

for  (r  =  0  ,  r  <  f_ysize  ;  r+  +)  { 

for  (c  =  0  ,  c  <  f_xsi2e  ;  c  +  +)  { 
dist  =  6.0  ; 
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for  (i  =  0  ;  i  <  f_number_inpute  ;  i  +  +) 

diet  +=  pow  (inp[i]  -  f_mep[r][c)[i],  2.0) 
if  (diet  <  minimum)  { 

minimum  =  diet ; 
cloee[0]  =  c ; 
do6e{l]  =  r ; 

} 


> 
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$  link  coder, option*  fitWopt 

/* 

*•**«*•*•***•«•«*****•*****••****  codf.c 


V 


This  routine  create*  an  untrained  aecond  Kohonen  with  stored 
trajectories  from  a  *.dat  file  and  teat  them  on  a  specified  set 
ot  digits  using  DTW  distance. 

Trajectories  are  100  x-y  pairs  filled  with  trailing  -1'a.  The 
user  may  choose  the  length  used  in  DTW  distance. 
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#  include  math 

#  include  stdio 

#  include  stat 

int 

int 

int 

char 

int 

float 

float 

double 

double 

int 

int 

int 

char 

char 

int 

int 

float 

float 

int 

int 

mindist  (close) 
int 

{ 

int 

double 

double 


numb*r_discretas  ; 
word_co unter ; 
num_word* ; 
wordjiumber  [  1 00]  [  1 5)  ; 

f_ysize,  f  xsize,  f  number  inputs  ; 
f_map[20]  [20]  [  1 6]  ; 

map{20](20][225]  ;  /*  output  nodes  */ 
input[225]  ;  I*  input  nodes  */ 
node  dist ; 

closest[2] ;  I*  closest  nod*  */ 
xsize,  ysize  ;  /*  Size  of  array  */ 
number  inputs  ; 

training_file[30],  temp_file(30J,  first_net_file[30J  ; 
net_file(30] ; 

mask  [20]  [20]  ; 
map2[20][20][100][2]  , 
aa  =  0.75 ; 
bb  =  0.75 ; 
length[200]  ; 
location  [2000]  [2]  ; 


*close  ; 

r,  c  ; 
dist ; 

minimum  =  9.99e31  ; 


for  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  xsize  ;  c  +  +)  { 

dtw  (&map2[r][c][0](0],  location,  mask[r][c], 
length  [0],  &dist)  ; 
if  (dist  <  minimum)  { 

minimum  =  dist ; 

‘close  =  c ; 
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> 

nod*  diet  =  minimum  ; 

> 

main  0 

{ 

int  c ; 

printl  ("\nCODER:  Create  codebook  ueing  x-y  pairs/dtw..An") ; 
map  speech  0  ; 

} 

map  speech  0 

< 

int  r,  c,  i.  j,  k  ; 

char  name_trj[30],  temp[30] ; 

int  loc ; 

FILE  *fnet,  ‘flog,  *fmask  ; 

printl  ("An  Enter  name  ol  pre-processor  Koh  net-file  [less  .net]'.  ”) 

scan!  ("%#",  temp)  ; 

sprint!  (first_net_file,  “%s.net",  temp)  ; 

print!  (“Enter  name  of  header  file  containing  words  (lees  hdr):  ") 

scant  ("%s",  temp_file)  ; 

sprint!  (training_file,  “%s.hdr".  temp_file)  ; 

print!  (“Enter  dat  file  for  net  generation  (leas  .dal)  : “)  ; 

scant  ("%e",  tempjile)  ; 

sprint!  (netjile,  "%s.dat",  temp_file)  ; 

printf  (“Enter  [number_inputs]  desired  (<  =  100):  ")  ; 
scant  ("%d",  &number_inputs)  ; 

readtmfile  0  I 

flog  =  fopen  (“temp.log”, "w") ; 
fprintf  (flog,  “CODERAn") ; 
fprintf  (flog,  "%s  ->  %s  ->  %s\n ",  trainingjile, 
first_net_file,  net_file )  ; 

fprintf  (flog,  "Size  is  %d  by  %d  nodes\n  ",  xslze,  ysize)  : 

printf  ("\nExpect  %d  calculationsAn”,  num_words) ; 
fprintf  (flog,  "Expect  %d  calculationsAn",  num_words)  ; 
for  (r  =  0  ;  r  <  num_words  ;  r+  +)  { 
getin  0  ; 
mindist  (&loc) ; 

printf  ("Word  %3d  is:  %3d\n",  r,  loc)  ; 
fprintf  (flog,  "Word  %3d  is:  %3d\n",  r,  loc)  ; 

> 

printf  (“\nCalculations  finishedAn")  ; 
fcloee  (flog)  ; 

} 

dtw  (template,  utterance,  tjength,  u_length,  ave_dist) 
int  template[200](2],  utterance[2O0][2]  ; 

int  t_length,  ujength ; 

double  *ave  diet ; 

{ 

float  back _path{2][200] : 
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int  b_pl2]I200] ; 

ini  r,  c ; 

ini  ptr,  b_plr ; 

float  dl,  d2,  d3,  dM ; 

dial  =  0.0 ; 
b_ptr  =  1 ; 
b_p[0J[0]  =  1  ; 

for  (r  =  1  ;  r  <  t  length  ;  r+  +) 

b_Plof|r]  =  b_p[0](r-1J  +  1  ; 
for  (r  =  0  ;  r  <  tjangth  ;  r+  +)  { 

back_pathlO](r]  =  (dial  +  =  bb  *  ( 

aba  (utterance  [0]  [0]  -  tempiate[r][0])  + 
ebe(utterance[0][lj  -  t«mplata[r] [  1  ])))  : 

} 

for  (c  =  1  ,  c  <  ujength  ;  C++)  { 
if  (b_ptr  ==0)  { 

b_ptr  =  1  ; 
ptr  =  0 ; 

} 

else  { 

b _ptr  =  0 ; 
ptr  =  1  ; 

> 

for  (r  =  0  ;  r  <  tjength  ,  r+  +)  { 

dial  =  ab8  (utt  erance[c]  [0]  -  template[r)[0J)  + 
abs(utterance[c) [1  ]  -  template[r][1])  ; 
if  (r  ==  0){ 

back_path[ptr](r]  =  beckj>afh{b_ptr][r]  + 
(aa  *  dist) ; 

b_Plptr]Ir]  =  6_p(bjJtrJfr]  +  1  ; 

> 

else  { 

dl  =  back_path[b_ptr][r-l]  +  dist ; 
d2  =  back jjath[ptr][M]  +  {bb  *  dist) ; 
d3  =  back  pathjb  ptrjjrj  +  (aa  *  dist) ; 
if  (d2  <  =  d3  &&  d2  <  d1){ 

back_path[ptr]{r]  =  d2 , 
b_plptr](r]  =  bjj(ptr](r-1]  +  1  ; 

> 

else  if  (d3  <  =  d2  &&  d3  <  dl)  { 
back_path[ptr)[r]  =  d3 ; 
b_p[ptr](r)  a  bj>lbj3tr][r)  +  1  ; 
> 

else  { 

back_path[ptr][r]  =  dl  ; 
b_p[ptr](r)  =  b_p[b_ptr][r-1]  +  1 
} 

> 

} 

} 

*ave_dist  =  back _path{ptr][t  length-1]  /  b  p(ptr][t  langth-1)  ; 

} 

read  tm  file  0 

{ 

FILE  If,  *fnet ; 

int  j,  i,  r,  c  ; 

int  temp,  k,  number ; 
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tf  =  (open  (trainingjile,  “r") ; 
fecenf  (tf,  “%d”,  &num_worda) ; 

(or  0  =  0  ;  I  <  num_worde ;  i+  +) 

(scarf  (tf,  word_number[i]) ; 
fetoee  (tf) ; 

(net  =  (open  (first _net_fite,  “r") ; 

(scent  (tnet,”%d  %d  %d",  &f_ysize,  &f_xsize,  &f_number_inpute) ; 

(or  (r  =  0 ;  r  <  f_ysize ;  r++)  { 

(or  (c  =  0 ;  c  <  fjtsize  ;  c+  +)  { 

(or  (i  =  0  ;  I  <  (_number_inputs  ;  i+  +)  { 

(scant  ((net,”  %f’,  &(  map[r][c][i])  ; 

> 

> 

> 

(cloee  ((net) ; 

ysize  =  (xsize  =  10) ; 

(net  =  (open  (net_file,  “r”)  ; 

(scant  ((net,  ”%d",  &num_words)  ; 
tor  (r  =  0 ;  r  <  ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  xsize  ;  c+ +)  { 

for  (i  =  0  ;  i  <  100  ;  i++)  { 

(scant  ((net,"  %d  %d”,  &map2[rl[c][i)[0], 
&map2[r][c](i][1])  ; 

> 

> 

> 

(cloee  ((net) ; 

for  (r  =  0  ;  r  <  ysize  ,  r+  +)  { 

for  (c  =  0  ;  c  <  xsize  ;  c+  +)  { 
number  =  0 ; 

(or  (i  =  0  ;  i  <  number Jnputs  ;  i  +  +)  { 
if  (map2[r][c](i][0]  >  -1) 
number**  ; 

> 

mask(r][c]  =  number ; 

> 

) 

word  counter  =  0  ; 

> 

getin  0 

{ 

if  (word_counter  =  =  numwords) 
word_counter  =  0  ; 
read_word  (word_counter)  ; 
word_counter++  ; 


read_word  (pointer) 

in*  pointer  ; 

{ 

int  flag,  r,  c,  i,  j,  k  ; 

double  in(16],  dl,  d2,  d3,  d4,  d5  ; 

float  element ; 
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coder 


irt  toc2[2000][2],  Ioc3(2000][2]  ; 

FILE  land; 

int  sound,  point,  x(5],  y[S] ; 

irt  maxjrta ; 

doubte  max ; 

fsnd  =  fopan  (word_number  [point  or] ,  “r") ; 

sound  =  0 ; 

i  =0; 

flag  =  0 ; 

white  (flag  !  =  1)  { 

fscanf  (fsnd,  "XT'.  &etement) ; 
if  (feof(fsnd)  1=0) 
flag  =  1 ; 
else  if  (i  >  90) 

flag  =  1 ; 

else  { 

in[i]  =  (double)  element ; 
i++ : 

} 

if  ((i  =  =  15)  &&  (flag  =  =  0))  { 

t_mindist  (f_map,  in,  &(oc2[sound][0]) ; 

f-  0  ; 

sound  ++  ; 

> 

> 

fclose  (fsnd)  ; 

for  (i  =  0  ;  i  <  sound  ,  i+  +)  { 

ioc3[i][0]  =  Ioc2(i][0]  ; 
loc3[i][1]  =  toc2[i][1]  ; 

> 

maxjjts  =  sound ; 

...  Trajectory  Reduction ... 

for  (i  =  0  ;  i  <  j ;  i++)  { 

location[i][0]  =  Ioc2[i][0]  ; 
location[ij[lj  =  loc2[i][lj ; 

} 

length[0]  =  j ; 

for  (i  =  j ;  i<  200  ,  i++) 

location[i][l]  =  (location[i][0]  =  -1)  ; 


f_mindist  (f_map,  inp,  close) 
double  inp[16] ; 
int  close[2] ; 
float  f  map[20][20](16] ; 

{ 

int  r,  c,  i ; 
double  diet ; 

double  minimum  =  9.99e31  ; 

for  (r  =  0  ;  r  <  f_ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  f_xsize  ;  c+  +)  { 
diet  =  0.0  ; 

for  (i  =  0  ;  i  <  f_number_inputs  ;  i+  +) 

dist  +=  pow  (inp(i]  -  f_map[r][c][i],  2.0)  , 
if  (dist  <  minimum)  { 

minimum  =  dist ; 
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$  link  coderb, option*  file/opt 
f 

Coderb.C 

This  routine  create*  an  untrained  second  Kohonen  net  from  •  Vdat 
file  of  stored  trajectories  and  tests  It  with  a  specified  set  of 
digits  using  TAXI  distance. 


Trajectories  are  100  x-y  pairs  fitted  with  trailing  -1's.  The 
user  may  input  the  length  used  in  TAXI  distance. 
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V 

#  include  math 

#  include  stdio 

#  include  stat 

int 

number  discretes  ; 

int 

word_counter ; 

int 

num  words  ; 

char 

word_number(100]  [ !  5j  ; 

int 

f_ysize,  f  xsize,  f  number  inputs  ; 

float 

f_map[20]  [20]  [  1 6]  ; 

float 

map[20]  (20)  [225] ;  /*  output  nodes  */ 

double 

input[22S]  ;  /*  input  nodes  */ 

double 

node_dist , 

int 

closest[2] ;  /*  closest  node  */ 

int 

xsize,  ysize  ;  /•  Size  of  array  */ 

int 

number  jnputs : 

char 

training_file(30],  temp_file(30],  first jiet_file[30J ; 

char 

net_file(303 ; 

int 

mask  [20]  [20]  ; 

int 

map2[20]  [20]  [  1 00]  [2]  ; 

float 

aa  =  0.75 ; 

float 

bb  =  0.75  ; 

int 

length  [200]  ; 

int 

location[2000][2]  ; 

mindist  (close) 

int 

{ 

int 

•close  ; 

i.  r,  c ; 

double 

dist . 

double 

minimum  =  9  99e31  ; 

for  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  xsize  ;  c+  +)  { 
dist  =  0.0  ; 

for  (i  =  0  ;  i  <  number  jnputs  ;  i+  +)  { 

dist+  =abs(map2[r]{c][i][0]-location[i][0])  + 
abs(map2[r]  [c]  (ij(1  ]-location[i]  [1])  ; 

> 

dist/=  lengthfO] ; 
if  (dist  <  minimum)  { 
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minimum  =  diet ; 

•dose  =  c ; 

> 

} 

} 

node  diet  =  minimum  ; 

> 

main  0 

{ 

int  c  ; 

print)  ('AnCODERb  Create  codaboofc  using  x-y  pairs/taxi..  An”) ; 
map  speech  0  ■ 

} 

map_speech  0 

^  int  r,  c,  i.  j,  k  ; 

char  nsme_trj[30).  temp[30]  ; 

int  loc ; 

FILE  fnet,  *flofl,  'fmask  ; 

print)  ('AnEnter  name  o)  pre-processor  Koh  net-file  [less  net): ") , 

scan)  ("%e",  temp)  ; 

sprint)  (first_net_file,  “%s.net",  temp)  ; 

print)  (“Enter  name  of  header  file  containing  words  (less  hdr):  ”) ; 

scant  (“%»",  temp_file)  ; 

sprint)  (training_file,  “%8.hdr",  temp_file) ; 

print)  ("Enter  dat  file  for  net  generation  (less  dat):  ”) ; 

scant  (“%s",  tempjile)  ; 

sprint)  (netjile,  “%a.dat”,  temp_file) ; 

print)  ("Enter  [number Jnputs  <=  100].  ”)  ; 
scan)  ("%d",  inumber inputs)  ; 

read_tmjile  0  1 

flog  =  fopen  ("temp.log",  V)  ; 
fprintf  (flog,  “COOERAn”)  ; 
fprirrtf  (flog.  "%a ->  %s  ->  %s\n",  training_flle, 
first  net  file,  net  file ) ; 

fprintf  (flog,  "Size'ia  %d  by  %d  nodes\n",  xsize,  ysize) ; 

print)  ('AnExpect  %d  calculationsAn",  numjvords) ; 
fprintf  (flog,  “Expect  %d  calculationsAn",  num_words)  ; 
for  (r  =  0  ;  r  <  num_words  ;  r+  +)  { 
getin  0  ; 
mindist  (&loc) ; 

print)  ("Word  %3d  is:  %3d\n".  r.  loc)  ; 

•print)  (flog,  'Word  %3d  is:  %3d\n".  r,  loc)  ; 

> 

print)  ("\nCalculations  fintshedAn  1  ; 

(close  (flog)  : 

> 

read  tm  file  0 

{ 
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coderb 


RLE 

*tf,  *fnet ; 

int 

).  i,  r,  c ; 

int 

temp,  k,  number ; 

tf  =  topen  (training_file,  "r") ; 
fscenf  (tf,  “%d",  &num_words)  ; 
for  (i  =  0 ;  i  <  num_worda ;  i+ +) 

fscanf  (tf,  "%e",  word_number[i]) ; 
fcloee  (tf) ; 

fnet  =  fopen  (first_net_file,  “r”) ; 

fscanf  (fnet,"%d  %d  %d”,  &f_ystze,  &f_xsize,  &f_number_inputa) ; 
for  (r  =  0  ;  r  <  f_ysize  ;  r+  +)  { 

for  (c  =  0  ,  c  <  fjesize  :  C++)  { 

for  (i  =  0  ;  i  <  f_number_inputs  ;  i++)  { 

fscanf  (fnet,"  %f",  &f  map[r][c][i]) ; 

} 

> 

} 

fclose  (fnet) ; 

ysize  =  (xsize  =  10) ; 
number Jnputs  =  100  ; 

fnet  =  fopen  (net_file,  "r")  ; 
fscanf  (fnet.  "%d",  &num_words) ; 
for  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  xsize  ;  c+  +)  { 

for  (i  =  0  ;  i  <  100  ;  i++)  { 

fscanf  (fnet,"  %d  %d".  &map2[r][c)[i)[0], 
&map2[r][c](i][1j)  ; 

} 

> 

> 

fclose  (fnet)  ; 

for  (r  =  0  ;  r  <  ysize  ;  r+  +)  { 

for  (c  =  0  ;  c  <  xsize  ;  c+  +)  { 
number  =  0  ; 

for  (i  =  0  ;  i  <  number  inputs  ;  i+  +)  { 
if  (map2[r][cj[i][0]  >  -1) 
number ++  ; 

} 

mask[r][c]  =  number ; 

} 

} 

word_courrter  =  0  ; 

> 

getin  0 

{ 

if  (word_counter  =  =  num_ words) 
word_counter  =  0 ; 
read_word  (word_counter) ; 
word_counter+  +  ; 


read_word  (pointer) 

int  pointer  ; 
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coderb 


int  flag,  r,  c,  i,  j,  k ; 

double  intlS],  dl,  d2,  d3.d4.dS; 

float  element ; 

int  Ioc2(a000][21,  Ioc3(2000][2]  ; 

FILE  ‘tend; 

int  sound,  point,  x{5],  y[S] ; 

int  max _pts ; 

double  max ; 

fsnd  =  fopen  (word_number [pointer] ,  “r") ; 

sound  =  0 ; 

i  =0; 

flag  =  0 ; 

while  (flag  I »  1)  { 

(scant  (fend,  “%f Aelement) ; 
it  (feof(fend)  !  =0) 
flag  =  1  ; 
else  if  (i  >  99) 

flag  =  1  ; 

else  { 


in[i]  =  (double)  element ; 
i++  ; 

} 

«((<==  15)44  (flag  ==0)){ 

f  mindist  (f  map,  in,  4loc2[sound}[0]} ; 
i~=  0 ; 
sound +  +  ; 

} 

} 

(close  (fend) ; 

for  (i  =  0  ;  i  <  sound  ;  i+  +)  { 

Ioc3[i][0]  =  Ioc2[i][0] ; 
loc3(i][1]  =  loc2[i][1]  ; 

} 

max_pte  =  sound  ; 

...  Trajectory  Reduction  ... 

for  (i  =  0  ;  i  <  j ;  i++)  { 

location[i][0]  =  Ioc2[i][0]  ; 
location[ij[lj  =  loc2[ij[1]  ; 

} 

length[0]  =  j ; 

for  (i  =  j ;  i  <  200  ;  i++) 

location[i][1]  =  (location[i][0]  =  -1)  ; 


f  mindist  (f_map,  inp,  close) 

double  inp[16] ; 

int  close[2]  ; 

float  f  map[20][20][16]  ; 

{ 

int  r,  c,  i  ; 

double  dist ; 

double  minimum  =  9.99e31  ; 

for  (r  =  0  ;  r  <  f_ysize  ;  r+  +)  ( 

for  (c  =  0  ;  c  <  f _xsize  ;  c  +  +)  { 
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codarb 


din  =  0.0 ; 

for  (i  =  0  ;  i  <  f_numb*r_input»  ;  i+  +) 

diet  +=  pow  (inp.,  -f_map[r][c][i],  2.0) ; 
if  (di at  <  minimum)  { 

minimum  =  dist ; 
cIom[0]  =  c ; 
ctoa#(lj  =  r  ; 

} 
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Appendix  C.  Software  User’s  Manual 

Introduction 

The  purpose  of  this  user’s  manual  is  twofold.  First,  it  will  demonstrate  how  to  use  the  “C” 
programs  developed  by  Capt  Barmore  for  his  thesis,  Speech  Recognition  Using  Neural  Nets  and 
Dynamic  Time  Warping.  Secondly,  it  provides  adequate  information  for  someone  with  a  raw  copy 
of  the  backup  tape  containing  source,  executable,  and  sound  files  to  modify  and  recompile  that 
information  on  his  own  system. 

Since  this  manual  is  written  as  an  appendix  to  the  subject  thesis,  it  does  not  have  a  table  of 
contents  or  index.  Thus,  it  is  suggested  that  the  reader  skim  the  manual  before  beginning  to  read 
in  depth.  The  section  headings  should  provide  adequate  information  about  the  manual’s  layout. 

Please  note  that  no  attempt  is  made  to  describe  all  of  the  programs  generated  for  this  thesis 
or  even  all  of  the  options  within  the  programs  described  below.  When  an  option  or  program  is  not 
described,  its  function  can  usually  be  determined  by  the  input  parameter  prompt  or  the  comments 
in  the  source  code,  respectively.  Also,  the  author  does  not  guarantee  the  performance  or  use  of  any 
program  provided  and  is  not  liable  for  any  damage  pursuant  to  the  use  of  any  of  these  progrants. 
Finally  this  code  was  developed  under  Air  Force  funding  and  is  therefore  the  property  of  the  United 
States  Air  Force. 

The  Backup  Tape 

The  backup  tape  is  simply  that— a  copy  of  all  of  the  files  used  in  the  subject  thesis  that  were 
stored  on  the  VAX  11/780  (with  node-name  1780A).  The  author  is  not  an  expert  on  backups  and 
magnetic  tape  format;  thus,  the  only  information  available  is  that  the  data  was  transferred  using 
the  “backup”  utility  under  the  VMS  operating  system.  The  directories  were  "purged",  but  no 
attempt  was  made  to  remove  data  or  program  files  that  were  either  superceded  or  just  not  useful 
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The  sections  immediately  following  this  paragraph  provide  a  general  description  of  the  con¬ 
tents  of  each  of  the  directories.  Sample  runs  of  the  most  significant  programs  are  provided  in 
later  sections.  The  names  of  the  following  subsections  actually  correspond  to  the  names  of  the 
directories — or  rather,  that  part  of  the  path  name  corresponding  to  the  subdirectories  beneath 
[KABR1SKY.GBARM0RE], 

Dev.  This  directory  contains  the  source  (*.e),  object  (*.o),  executable  (*.exe),  and  *.com  files 
generated  during  program  development.  Not  all  of  the  *.o  and  *.exe  files  were  saved.  However,  they 
can  be  regenerated  by  compiling  the  appropriate  source  file  (*.c)  with  a  “cc  filename”  command, 
or  by  relinking  the  object  files  using  the  respective  *.com  files  in  a  "'^filename”  command.  Notice 
that  the  ’.corn  files  contain  the  link  command  for  the  appropriate  program.  Also,  if  the  user  is  not 
on  a  VMS  system,  he  may  have  to  modify  the  two  commands  just  described. 

When  recompiling  on  a  VMS  system,  the  following  two  commands  should  be  executed  prior 
to  the  ”cc”  command: 

DEFINE  LNKfcLIBRARY  SYStLIBRARY : VAXCCU&SE.OLB 

DEFINE  LNKALIBRARY.l  SYS$LIBRARY : VAXCRTL . OLB 

The  “include”  commands  in  each  source  file  should  also  be  examined  for  correct  format  VMS 
does  not  (in  most  cases)  use  the  UNIX  format.  Additionally,  some  programs  use  C>KS 

graphics.  The  source  files  for  these  programs  contain  the  line  “#  include  <gksdefs.h>” .  For  these 
programs  to  run  effectively,  the  workstation  used  should  have  at  least  the  capability  of  a  Micro- VAX 
II. 


Lin.  Most  of  the  work  performed  in  this  thesis  used  sound  files  sampled  and  digitized  using 
a  logarithmic  sampling  scheme  to  increase  dynamic  range.  However,  tests  were  run  to  see  if  there 
was  any  difference  when  normal,  linear  sampling  was  used.  This  directory  contains  the  files  used 
for  those  tests. 
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Net.  A  number  of  small  sound  files  that  approximate  “pure”  phonemes  are  found  in  this 
directory.  These  were  used  to  see  where  a  particular  sound  was  placed  in  the  first  Kohonen  net. 

Snd2.  This  directory  contains  an  assortment  of  *.trn  files  (generated  by  the  AUTOFFT 
routine  with  a  *.snd  file  as  input)  used  in  the  early  development  and  testing  of  the  DTW  routines. 
Notice  that  the  Kohonen  nets  in  this  directory  are  named  in  the  “speech*. net”  series.  This  series 
was  an  early  version  of  the  first  Kohonen  net  and  is  not  used  in  any  of  the  results  reported  in  this 
thesis. 

Snd3.  The  files  in  this  directory  are  used  to  perform  AUTODTW  runs.  Notice  that  the  first 
Kohonen  net  files  in  this  directory  are  the  named  in  the  final  series,  “speak*. net” . 

Sndw.  Most  of  the  sound  files  used  in  this  thesis  were  sampled  with  a  resolution  of  eight 
bits  per  sample  on  an  ATARI  microcomputer.  The  files  in  this  directory  were  sampled  using  a  16 
bit  A/D  converter.  Only  limited  tests  were  performed  on  these  files. 

Sounds.  The  files  in  this  directory  are  the  sound  (*.snd)  files  from  which  the  *.trn  files  were 
generated  that  trained  both  the  first  and  second  level  Kohonen  nets  as  well  as  testing  the  first 
Kohonen  nets.  These  files  include  a  large  number  of  isolated  words  identified  by  "*word*.snd” 
where  “word”  is  replaced  by  one  choice  from  the  following  set:  {one,  two,  three,  . . nine,  silence}. 
The  content  of  the  files  should  be  obvious. 

Also  included  in  this  directory  are  several  continuous  speech  utterances.  These  include  the 
first  net  training  utterances,  usually  identified  as  “*dig*.snd”,  and  connected  utterances  used  in 
AUTODTW  tests  (either  “b*.snd”  or  “g*.snd”).  The  “*dig*.snd"  files  contain  the  sequence  of  digits 
zero  through  nine  spoken  in  order,  usually  with  short  pauses  between  the  digits.  The  background 
noise  (silence)  is  a  quiet  computer  hum. 

The  “b*.snd”  and  “g*.snd"  files  contain  selected  sequences  of  digits  that  were  chosen  to 


correspond  to  the  utterances  used  by  Capt  Dawson  in  his  thesis  (13)  the  preceding  year.  The 
contents  of  each  file  can  be  determined  simply  by  examining  how  the  is  replaced  in  the  file 
name.  For  example,  if  the  file  is  “b282828.snd”,  it  contains  the  sequence  of  words  2-8-2-8-2-8. 
The  “b*.snd”  series  were  spoken  clearly  and  distinctly.  The  “g’.snd”  series  were  spoken  in  a  fast, 
slurred  fashion. 

SoundaZ.  This  directory  contains  the  sound  files  from  which  the  *.trn  files  were  generated 
to  test  the  second  Kohonen  nets.  It  also  contains  the  “m’.snd”  series  of  connected  utterances. 
These  connected  utterances  were  spoken  by  a  different  speaker  than  all  of  the  other  utterances. 
The  “m*.snd”  series  were  spoken  by  a  female  with  a  relatively  deep  voice,  while  all  of  the  other 
utterances  are  in  a  mid-range  male  voice.  See  the  preceding  section  entitle  “Sounds”  for  the  naming 
conventions. 

Src.  This  directory  was  an  early  attempt  to  separate  the  source  files  (*.c)  for  shorter,  limited 
backups.  The  plan  was  abandoned  early,  and  all  of  these  files  are  duplicated  in  the  directory  [  DEV], 

Test.  These  files  were  used  in  the  first  tests  of  the  AUTODTYV  program. 

Programs 

Each  of  the  programs  described  below  are  found  in  the  directory  [  DEV],  The  preceding 
subsection,  “Dev”,  should  be  referenced  for  comments  on  how  to  recompile  the  programs.  It  is 
recommended  that  most  of  these  programs  be  run  in  the  batch  mode.  With  few  exceptions,  any 
of  these  programs  will  run  from  1.5  to  12  hours  given  typical  input  parameters  and  a  Micro- VAX 
workstation. 

Each  program  description  states  the  purpose  of  the  program,  the  required  inputs,  and  the 
form  of  the  output.  A  sample  interactive  session  is  included  where  it  is  appropriate,  and  when 
necessary,  additional  comments  are  made. 
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Autofft.  The  program  AUTOFFT  converts  a  sound  file  (*.snd)  into  a  file  (*  .trn)  containing 
a  sequence  of  15  component  vectors.  The  *.snd  file  is  binary,  has  eight  bytes  of  header  information, 
and  contains  an  unspecified  number  of  sound  samples  (one  sample  per  byte).  In  the  sound  file,  the 
binary  integers  from  —128  to  —1  are  mapped  into  the  range  +128  to  +255.  Basically,  AUTOFFT 
performs  the  preprocessing  functions  on  the  sound  waveform. 

To  simplify  the  user’s  effort  in  preprocessing  a  large  number  of  files,  AUTOFFT  reads  the  file 
“sounds. hdr”  to  obtain  the  names  of  the  *.snd  files  to  preprocess.  An  example  of  “sounds. hdr”  is: 

I780A>type  sounds. hdr 

2 

lzero 

six2 

I780A> 

Notice  that  the  “2”  corresponds  to  the  number  of  files  to  be  processed,  and  that  each  filename 
does  not  include  the  three  letter  file-type.  Files  “lzero.snd”  and  “six2.snd”  must  be  present  in  the 
current  directory  or  an  error  will  result  when  AUTOFFT  is  executed.  The  following  is  a  sample 
run: 

I780A>run  autofft 

FFT3:  Time/Frequency  Conversion  for  Kohonan  Hat  ... 

Enter  (0)  logarithmic,  or  (1)  Kohonan  reduction:  0 
lzero. trn  opened  ...  84  vectors. 
six2.trn  opened  ...  63  vectors. 

I780A> 

The  type  of  reduction  (from  128  to  15  components)  described  in  the  thesis  is  (0)  logarithmic. 
The  (1)  Kohonen  style  reduction  approximates  the  methods  described  in  Kohonen’s  articles,  but 
does  not  work  very  well  since  no  corresponding  filter  is  used. 

Neural! .  Once  a  training  file  (*.trn)  is  preprocessed  using  AUTOFFT.  it  can  be  used  to  train 
the  first  level  Kohonen  neural  net  with  the  program  NEURAL7.  The  net  created  with  NEURAL7 
is  a  two  dimensional  net  limited  to  no  more  than  20  nodes  in  either  direction  (400  nodes  total). 
The  program  is  “hardwired”  for  15  inputs  (a  15  component  input  vector)  and  a  conscience  factor  of 
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0  =  1.5.  The  conscience  factor  is  easily  changed  since  it  is  a  global  variable  set  at  the  beginning  of 
the  “neural7.c”  file.  Simply  change  the  value  and  recompile.  Alternatively,  one  can  easily  modify 
the  program  to  make  0  an  input  variable  (by  changing  the  subroutine  “userinp”  in  “neural7.c”). 


A  sample  run  shows  the  input  parameters  and  the  status  information: 

I780A>ruu  neural 7 

IEURAL7  (let  training  with  conscience  only!)  ... 

Enter  size  ‘m  n’  (for  an  a  z  n)  of  array  =  ?  [int  int]  IB  IS 
Enter  naae  of  training  file  C.trn  assumed]:  ldig3 
Training  file  is:  ldig3.trn 

Enter  naae  of  net  file  to  create  C-net  appended]:  speakl 
let  file  to  be  created:  speakl.net 
lumber  of  iterations  =  ?  [int]  90000 

Number  of  iterations  between  status  messages  =  ?  [int]  4S000 

Por  gain  enter  0)  LINEAR,  1)  SIGMOIDAL,  2)  PIECEWISE  LINEAR  :  2 

First  segment  starting  gain  =  ?  [float]  . 1 

Second  segment  starting  gain  =  ?  [float]  .01 

Second  segment  starting  iteration  =  ?  [float]  20000 

Do  you  want  0)  sequential  or  1)  randomized  training?  0 

Starting  size  of  neighborhoods  *yn  zn'  =  ?  [int  int]  7  7 

Final  size  of  neighborhoods  ’yn  zn’  =  ?  [int  int]  1  1 

Initial  seed  for  random  •  generator  (0  SELECTS  TIME)  =  ?  [int]  33 

Ready  to  begin?  (y/n)  y 

NEURAL3:  gain=0 . 006428,  yrange=l,  xrange=l,  iteration  #45000  (of  90000) 
37  ave  nodes  eliminated 

NEURAL3:  gain=0 . 000000 ,  yrange=l,  xrange=l,  iteration  #90000  (of  90000) 

36  ave  nodes  eliminated 

Net  file:  3pe21kl.net  saved! 

I780A> 


Most  of  the  questions  are  self  explanatory,  but  the  request  for  a  gain  curve  is  not.  The  gain 
curve  can  be  either  linear,  sigmoidal,  or  ,  iecewise  linear  (hardwired  for  two  segments).  The  linear 
gain  curve  is  simply  a  linear  (continuously  decreasing)  change  in  gain.  A  sigmoidal  curve  starts 
high  and  ends  low,  but  such  a  gain  curve  (as  implemented  here)  does  not  seem  to  properly  train  a 
net.  The  piecewise  linear  curve  works  well,  with  both  gain  segments  ending  in  zero  gain. 

The  application  of  15  component  training  vectors  to  the  inputs  of  the  net  can  be  either 
sequential  or  random.  In  the  former,  the  first  vector  in  the  file  is  applied  first,  and  the  rest  in  order. 
If  the  number  of  training  iterations  required  is  greater  than  the  number  of  vectors  in  the  file,  the 
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sequence  of  vectors  is  simply  repeated.  Random  training  picks  a  vector  from  the  training  file  at 
random  for  each  application  of  an  input. 

The  size  of  the  training  neighborhood  is  changed  in  a  linear  fashion.  The  neighborhood  is 
specified  by  a  value,  r  (actually  two  such  values),  such  that  the  size  of  the  neighborhood  in  the 
respective  direction  is  2r  +  1  nodes.  Thus  a  starting  neighborhood  of  “7  7”  is  actually  a  “15  x  15” 
array  of  nodes. 

The  seed  for  the  random  number  generator  should  be  selected  by  the  user.  The  code  for 
obtaining  the  seed  by  examining  the  time  still  has  a  bug  in  it;  also,  specifying  a  seed  allows 
reproduction  of  the  resulting  net. 

Finally,  note  the  program  title  is  not  correct  in  the  status  message  (an  oversight),  and  the 
“results”  of  conscience  are  reported.  The  average  number  of  nodes  eliminated  is  the  average  number 
of  nodes,  per  training  iteration  in  the  reporting  period,  not  eligible  to  “light  up"  (as  the  center 
node  in  the  neighborhood). 


Neural2.  This  program  displays  a  first  Kohonen  net  graphically.  Each  node  is  represented 
by  15  vertical  bars  in  a  small  spectrum-like  graph.  The  15  bars  correspond  to  the  15  positive  and 
negative  weights.  The  spectra  are  shown  in  an  array  corresponding  to  the  size  of  the  actual  net. 
GKS  graphics  routines  are  used.  The  following  is  a  sample  run: 

I780A>run  neural2 

HEURAL2  (Sound  net  Training  with  GRAPHICS  only!)  ... 

Do  you  want  to  train  a  net?  (y/n)  n 
Do  you  want  to  draw  spectra  ol  a  net?  (y/n)  y 
Enter  name  ol  net-lile  to  test:  speakl.net 
Was  this  generated  by  (0)  FFT2  or  (1)  FFT3  ?  1 

. . .  graphics  displayed  now  . . . 

I780A> 


Notice  that  you  can  also  train  a  net  (without  conscience),  however,  it  is  much  slower  since 
graphics  are  provided  as  status  messages.  The  current  version  of  preprocessing,  incorporated  into 
AUTOFFT,  corresponds  to  FFT3.  After  the  graphics  display  is  complete,  the  program  is  exited 
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by  the  user  entering  any  string  followed  by  a  carriage  return.  This  is  the  standard  way  to  leave  alt 
graphics  displays  in  these  programs! 


Neural4.  This  program  permits  the  user  to  graph  trajectories  through  the  first  Kohonen 
net.  Again  GKS  graphics  routines  are  used.  The  following  is  a  sample  run: 

I780A>run  neural4 

■EURAL4  (Sound  TRAJECTORIES  only!)  ... 

Do  you  want  (0)  sound  fils  created  or  (1)  not?  1 
Do  you  want  (0)  MO  graphics  or  (1)  TRAJECTORIES:  1 
Enter  nans  of  net-file  to  use  [less  .net]:  speakl 
Enter  name  [next]  of  speech  file  to  sap  [less  .trn]:  zero3 
. . .  full  trajectory  graphed  here  . . . 

1 

...  reduced  trajectory  graphed  here  ... 

1 

Enter  name  [next]  of  speech  file  to  map  [less  .trn]:  zero6 
...  full  trajectory  graphed  here  ... 

1 

. . .  reduced  trajectory  graphed  here  . . . 

*C 

I780A> 


Notice  that  a  *.snd  file  can  be  regenerated  from  the  trajectory  (if  you  know  what  file  was 
used  to  train  the  net  and  if  the  training  utterance's  *.snd  and  *.trn  files  are  located  in  the  current 
directory).  However,  creating  a  sound  file  is  slow  and  incorporates  distortion  from  various  sources. 
If  no  graphics  are  desired,  an  ASCII  file  (*.trj)  is  created  (it’s  actually  created  in  either  case)  which 
contains  the  various  steps  in  the  trajectory  reduction  process.  Each  graphics  display  is  left  by 
entering  a  string  (here  it’s  “1”)  and  a  carriage  return. 
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Autodtur.  This  program  uses  dynamic  time  warping  to  test  a  set  of  standard  utterances. 

Trajectories  are  created  for  a  set  of  templates,  which  in  turn  are  compared  with  the  trajectories 

created  for  the  set  of  standard  utterances.  The  templates  are  listed  in  a  file  such  as  "t2.hdr”: 

I780A>type  t2.hdr 
11 

lzero3.trn 
lon«3 . trn 
ltwo3 . trn 
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lthr««3 . trs 

four5.tra 

lfiv*3.trn 

sixS.trn 

lssven3.trn 

lsight3 . trn 

lnin«3.trn 

sil«nc«3.tm 

I780A> 


A  file  called  “standard. hdr”  which  contains  the  names  of  the  files  listing  the  standard  utter¬ 
ances  must  be  in  the  current  directory.  For  example: 

I780A>typs  standard. hdr 

4 

iso . hdr 

Spsaksr.Dspendent. Isolat ed.tf ords 
con . hdr 

Spsaksr.Dspsndsnt.Connect  ed.Vords 
indiso .hdr 

Speaker. I HDEPEHDEIT. I solat sd.Uord s 
indcon . hdr 

Speaker. INDEPEVDEIT.Connected. Words 
I780A> 


The  strings  following  each  file  name  in  standard. hdr  are  printed  out  during  an  AUTODTVV 

run  prior  to  the  tests  on  that  file's  set  of  utterances.  Scoring  is  performed  automatically  in 

AUTODTW,  and  cumulative  scores  are  reported  for  each  file’s  set  of  utterances.  An  example 

of  a  set  of  utterances  is: 

I780A>type  iso. hdr 
5 

kzerol.trn  1 
0 

konel.trn  1 
1 

ktwol.trn  1 
2 

kthreel.trn  1 
3 

IdigS.trn  10 

01234S6789 

I780A> 
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Notice  that  the  first  number  in  the  file  is  the  number  of  utterances  to  test.  Then  comes  the 
file  names  of  each  utterance  followed  by  the  number  of  digits  in  the  respective  utterance  and  what 
those  digit(s)  are. 

With  all  of  the  above  files  in  the  current  directory,  along  with  a  trained  net,  AUTODTW  can 
be  run: 

I780A>run  autodtw 

AUTODTW:  Tests  standard  set  of  utterances  . . . 

Enter  name  of  template  file  [less  .hdr] :  t2 

Enter  name  of  log  file  [add  .log]:  temp.log 

Enter  horizontal  weight:  .75 

Enter  vertical  weight:  .75 

Enter  name  of  net  to  use  [less  .net]:  spe&kl 
lzero3.trn  is  75  vectors  long 
lone3.tm  is  65  vectors  long 
ltwo3.trn  is  52  vectors  long 
lthree3.trn  is  68  vectors  long 
four5.trn  is  69  vectors  long 
lfive3.trn  is  52  vectors  long 
six8.trn  is  65  vectors  long 
lseven3.trn  is  70  vectors  long 
leight3.trn  is  37  vectors  long 
lnine3.trn  is  82  vectors  long 
silence3.trn  is  16  vectors  long 

Speaker_Dependent_Isolated_Vords 
kzerol.trn  is:  0 
Should  be :  0 

correct  *  1.000  cum_correct  =  1.000 
koenl.trn  is:  1 
Should  be:  1 

correct  =  1.000  cua_correct  =  1.000 


ldig3 . trn  is:  0123. .4567. .89 
Should  be:  0123456789 
correct  =  1.000  cum.correct  =  1.000 

Speaker_Dependent .Connect ed_Words 

results  continue  . . . 

I780A> 
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The  weights  requested  are  the  stretch  factors  used  in  the  DTW  routine.  In  addition  to 
printing  the  results  on  the  terminal’s  screen  (about  five  seconds  per  digit),  the  results  are  written 
to  the  log  file,  “temp.log”.  The  seen  in  the  output  represents  silence.  Note  that  substitutions 
and  deletions  count  as  one  error  while  insertions  only  count  as  half  an  error  (this  is  hardwired  in 
the  scoring  DTW  routine’s  stretch  factors).  Also  be  aware  that  there  are  unusual  cases  where  the 
scoring  will  make  a  mistake  on  isolated  speech.  Check  all  results  by  examining  the  log  file. 


OutdaH.  To  save  time  in  training  the  second  level  Kohonen  nets,  a  set  of  trajectories  is 
precalculated  and  stored  (for  later  use  in  TWOBAS4)  by  OUTDAT4.  The  list  of  utterances,  from 
which  the  trajectories  are  made,  is  kept  in  a  header  file.  For  example: 

I780A>type  t«okoh2.hdr 
100 

zeroO.trn 

oneO.tra 

twoO.trn 

threeO.trn 

fourO.trn 

fives. trn 
sixS.trn 
sevens. trn 
eights. trn 
nines. trn 
I780A> 


In  the  example  shown,  100  trajectories  are  created.  10  of  each  of  the  10  digits.  The  actual 
run  might  be: 

I780A>run  outdat4 

0UTDAT4:  Prepare  training  data  [x,y],  second  kohonen  ... 

Enter  name  of  header  file  containing  sords  (less  . hdr):  twokoh2 
Enter  naae  of  pre-processor  Kohonen  net  file  [less  .net]:  speakl 
Enter  name  of  data  file  to  create  [less  .dat]:  qpath 
I780A> 


The  trajectories  are  stored  in  the  ASCII  file,  “qpath.dat”. 
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Twobaaj .  This  program  trains  the  second  Kohonen  net  and  requires  input  parameters  very 
similar  to  NEURAL7.  The  biggest  differences  are  the  precalculated  trajectories  (isolated  digits) 
and  user  selectable  conscience  factor  (/?).  A  sample  run  is: 

I780A>run  twobas4 

TW0BAS4:  Train  2nd  Koh  with  2-D  trajectories  ... 

Enter  conscience  factor  (>  1.0):  [float]  l.S 

Enter  size  *m  n’  (for  an  ■  z  n)  of  array  =  ?  [int  int]  10  10 

Oo  you  want  0)  sequential  training, 

1)  randonized  training?  0 
Enter  name  of  training  file  [less  .dat]:  qpath 
Enter  name  of  net  file  to  create  [leas  .net]:  path21 
lumber  of  iterations  =  ?  [int]  150000 

lumber  of  iterations  between  status  messages  =  ?  [int]  10000 

For  gain  enter  0)  LINEAR,  1)  SIGMOIDAL,  2)  PIECEWISE  LINEAR  :  2 

First  segment  starting  gain  =  ?  [float]  .1 

Second  segment  starting  gain  =  ?  [float]  .01 

Second  segment  starting  iteration  =  ?  [float]  30000 

Starting  size  of  neighborhoods  ’yn  m’  =  ?  [int  int]  4  4 

Final  size  of  neighborhoods  'yn  xn’  =  ?  [int  int]  1  1 

Initial  seed  for  random  S  generator  -  ?  [int]  33 

Ready  to  begin?  (y/n)  y 

TW0BAS4:  gain=0. 066669,  yrange=3,  xrange=3,  iteration# 10000  (of  150000) 

TV0BAS4:  gain=0. 000000,  yrange=l ,  xrange=l,  iteration#150000  (of  150000) 
let  file:  path21.net  saved! 

I780A> 


TwomaskS.  Since  a  lot  of  the  “trailing"  weights  at  the  end  of  any  node's  weight  vector 
are  —l’s,  a  *.msk  file  is  created  by  TWOMASK5  (where  corresponds  to  the  in  the  net 
file  '  *.net”  created  by  TWOBAS4).  The  *.msk  is  an  ASCII  file  used  in  the  TWOPIC  series  of 
programs  to  identify  the  effective  length  of  the  trajectories  represented  by  each  node's  weight  vector. 
Running  the  program  is  simple: 

I780A>run  twomask5 

TW0MASK4  (Creates  net  mask  for  2-D  trajectories 

)  ...  Enter  name  of  output  Koh  net.file  [less  .net]:  pathll 
status  information  . . . 

I780A> 


Obviously,  correcting  prompt  messages  had  a  low  priority  in  the  thesis  work. 
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Twopicjc.  This  program  shows  graphically  which  nodes  light  up  (using  Euclidean  distance) 
when  a  set  of  isolated  digits  are  applied  to  a  second  Kohonen  net.  This  program  uses  GKS  graphics 
routines.  For  example: 

I780A>run  twopic4c 

TW0PIC4c  (Plot  Words  lor  2-0  Reduced  Queued  Traj)  ... 

Enter  name  of  pre-processor  Koh  net-lile  [less  .net]:  speakl 
Enter  naae  ol  header  file  containing  words  (less  .hdr):  twokoh2 
Enter  naae  ol  output  Koh  net.lile  [less  .net] :  pathll 
. . .  graph  net  . . . 

1 

I780A> 


Notice  that  the  header  file  containing  the  utterances  has  the  same  format  as  that  used  in 
OUTDAT4.  Again,  a  string  and  carriage  return  exit  the  graphics  display. 


Twopic8b.  This  program  finds  the  appropriate  digit,  with  which  to  label  each  node  in  a 
second  Kohonen  net,  by  looking  through  a  list  of  trajectories  and  finding  the  closest  one  (by  a 
mini-DTVV)  to  each  node's  weight  vector.  Again,  the  file  listing  the  utterances  is  in  the  same 
format  used  by  OUTDAT4  A  sample  run  is: 

I780A>run  twopic8b 

TW0PIC8b  (Closest  word  lor  each  node:  100  wts/2-D  )... 

Enter  name  ol  pre-processor  Koh  net-lile  [less  .net]:  speaklO 
Enter  name  ol  header  lile  containing  words  (less  .hdr):  test3 
Enter  name  ol  output  Koh  net.lile  [less  .net] :  path22 
Expect  100  calculations 

Reading  word:  0  1  2  3  4  S  6  7  8  9  10  1 1  12  13  14  15  16  17  18  19  20  21  22 

23  24  25  26  27  28  29  30  31  32  33  34  35  36  37  38  39  40  41  42  43  44  45  46 

47  48  49  50  51  52  53  54  55  56  57  58  59  60  61  62  63  64  65  66  67  68  69  70 

71  72  73  74  75  76  77  78  79  80  81  82  83  84  85  86  87  88  89  90  91  92  93  94 

95  96  97  98  99 

■ode  0  :  word  #  22,  dist  =  9.465583e-01  (dtwo2.trn) 

■ode  99  :  word  #  87,  dist  =  0.423736e-00  (deight7 . trn) 

Calculations  linished. 

I780A> 
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The  output  is  written  to  “temp.log”  in  addition  to  being  displayed  on  the  terminal’s  screen. 
Notice  how  the  program  “labels”  a  node — by  giving  the  user  the  closest  trajectory.  In  this  example, 
node  99  is  identified  as  an  eight.  The  output  of  this  program  should  be  saved  for  use  in  TW0PIC6b. 


Twopic6b  This  program  takes  the  node  labels  determined  by  TW0PIC8b  and  tests  a  set 
of  unknown  utterances  (using  mini-DTW  as  the  distance  algorithm).  Unfortunately,  each  time 
T\VOPIC8b  is  run  and  the  labels  are  changed,  the  file  “lookup6.c”  must  be  modified  and  recom¬ 
piled  and  then  TWOPIC6b  relinked.  This  process  could  be  modified  with  code  changes  to  both 
T\VOPIC8b  and  TWOPlC6b.  But  for  now,  this  is  the  portion  of  “lookup6.c"  that  must  be  changed 
to  reflect  the  results  of  TWOPIC8b: 

I780A>typa  lookups. c 

int  look_up[100]  =  {9, 9, 9, 3, 7, 7, 7, 6, 6, 6, 

9, 9, 3, 3, 3,3, 6,6, 6,6. 

9, 9, 3, 2, 3, 0,6, 6, 6, 6, 

1,1, 1.3. 3, 0,3, 6, 6, 6, 

1,1, 1,3, 0,0, 0,4, 4,4, 

3, 1.9, 3, 0.0, 0,0, 4, 4, 

5, 3. 3, 3, 3, 3, 7. 0,4,0, 

5.5.2, 3, 2, 7, 7, 7, 8, 2, 

5, 5, 2, 2. 3, 3, 7, 4, 8, 8, 

5. 5, 9, 3, 0,3, 4, 3, 8, 8}  ; 

I780A> 


In  this  lookup  table,  each  row  of  integers  corresponds  to  the  digits  labelling  a  row  of  nodes. 

The  first  node  is  the  first  integer,  the  last  node  is  the  1 00th  integer.  Note  that  the  program  is 

hardwired  for  a  10  by  10  Kohonen  neural  net.  The  update  process  is: 

I780A>edit  lookup6 . c 

I780A>cc  lookups 

I780A>®twopic6b 

I780A> 


In  this  case  twopic6b.com  consists  of: 


I780A>typa  taopic6b.com 


€ 


« 


« 


t  del  twopic6b.exe 

$  link  twopic6b,nvin5b,lookup6,options_f ile/opt 

I780A> 

Now,  the  user  is  ready  to  run  TWOPIC6b  to  actually  test  the  speech  recognition  capability 
of  a  second  Kohonen  net.  For  example: 

I780A>run  tsropicdb 

TW0PIC6B  (DTV  Words  for  2-D  Reduced  Queued  Traj)  ... 

Enter  name  of  pre-processor  Koh  net-file  [less  .net]:  speaklO 

Enter  naae  of  header  file  containing  vords  (less  .hdr):  test3 

Enter  nave  of  output  Koh  net.file  [less  .net]:  path21 

Expect  100  calculations. 

0  :  [0,4]  dist  =  1.3S0917e+00  zero 

99  :  [8,6]  dist  =  0.938755e-01  nine 

Calculations  finished. 

1780A> 

Notice  that  each  word  from  “test3.hdr”  is  identified  by  a  sequential  number  (here  0  through 
99)  according  to  its  order  in  “test3.hdr”.  The  node  that  lit  up  is  in  braces,  and  the  dijrit  the 
utterance  was  found  to  be  is  spelled  out  in  the  far  right  column.  Scoring  this  output  requires 
knowing  what  word  is  in  what  position  in  “test3.hdr”.  To  simplify  the  scoring  procedure,  the 
author  (almost)  always  used  10  examples  of  each  of  the  10  digits  in  order. 

Twopic8c.  This  is  a  later  version  of  TWOPlC8b  where  the  mini-DTW  distance  algorithm 
is  changed  to  a  TAXF  distance. 

Twopicffc.  This  is  a  later  version  of  T\VOPIC6b  where  the  mini-DTW  distance  algorithm  is 
changed  to  a  TAXI  distance.  In  this  case,  “Iookup7.c”  (instead  of  “lookup6  c")  should  be  updated 
with  the  results  from  TYVOPIC8c. 

Coder.  This  program  creates  (and  tests)  an  “untrained”  second  Kohonen  net  from  a  file  of 
precalculated  trajectories  (created  by  OUTDAT4).  The  trajectories  are  transferred  directly  to  the 
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nodes’  weight  vectors  without  any  training.  Tests  are  run  on  the  untrained  net  for  a  set  of  test 
utterances.  The  distance  algorithm  is  a  mini-DTW.  The  following  is  a  sample  run: 

I780A>run  coder 

CODER:  Create  codebook  using  x-y  pairs/dts  ... 

Enter  naae  of  pre-processor  Koh  net-file  [less  .net]:  speakl 
Enter  naae  of  header  file  containing  words  (less  .hdr):  testl 
Enter  .dat  file  for  net  generation  (less  .dat):  qpath 
Enter  Cnunber.inputs]  desired  (<=100):  75 

Expect  100  calculations. 

Word  0  is:  0 
Word  1  is:  0 

Word  99  is:  9 
Calculations  finished. 

I780A> 


The  far  right  column  corresponds  to  the  calculated  content  of  the  word  being  tested.  It 
assumes  that  “qpath.dat”  was  generated  from  100  words,  10  of  each  digit  in  sequence.  For  simplicity 
in  scoring,  the  author  placed  a  similar  sequence  of  digits  (using  other  examples)  in  “testl. hdr”. 
Notice  that  the  number  of  inputs  is  variable  in  this  program. 

Coderb.  This  program  is  the  same  as  CODER,  except  that  the  mini-DTW  distance  algo¬ 
rithm  is  changed  to  a  TAXI  algorithm. 


Summary 

The  above  paragraphs  describe  both  the  contents  of  the  backup  tape  and  the  most  significant 
programs  found  on  that  tape.  Further  questions  can  be  answered  by  contacting  the  author  or 
perusing  the  source  code  found  in  the  directory  (DEVJ  or  Appendix  B  of  this  thesis. 
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